[2021-03-25 10:50:53.129] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:50:53.129] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:50:53.129] [local ee] [info] initializing LLVM backend
[2021-03-25 10:50:53.129] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:50:53.129] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:50:53.130] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 10:50:53.130] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:50:53.130] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:50:53.130] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:50:53.264] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:53.270] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:53.286] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:53.294] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:53.320] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:53.340] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:53.353] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:53.384] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:50:53.390] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:53.405] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:50:53.407] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:53.408] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:53.409] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:50:53.410] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:53.411] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:53.412] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:50:53.413] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:53.415] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:50:53.415] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:50:53.431] [logical planner] [info] logical optimization took 0.021917ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:50:53.431] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:50:53.432] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:50:53.433] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:50:53.433] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:50:53.434] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:50:53.434] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:50:53.435] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:50:53.436] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:50:53.437] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:50:53.438] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:50:53.438] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:50:53.440] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:50:53.440] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:50:53.441] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:50:53.442] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:50:53.443] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:50:53.444] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:50:53.444] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:50:53.445] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:50:53.445] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:50:53.446] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:50:53.447] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:50:53.448] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:50:53.449] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:50:53.449] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:50:53.451] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:50:53.451] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:50:53.452] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:50:53.452] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:50:53.484] [global] [info] Stage0 depends on: 
[2021-03-25 10:50:53.834] [global] [info] Optimization via LLVM passes took 0.332417 ms
[2021-03-25 10:50:53.986] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:50:53.986] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.50159s
[2021-03-25 10:50:53.986] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:50:54.268] [driver] [info] [Task Finished] Transform to mem in 0.282148s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:50:54.548] [driver] [info] [Task Finished] Transform to mem in 0.279302s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:50:54.827] [driver] [info] [Task Finished] Transform to mem in 0.279524s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:50:55.107] [driver] [info] [Task Finished] Transform to mem in 0.279989s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:50:55.387] [driver] [info] [Task Finished] Transform to mem in 0.279381s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:50:55.666] [driver] [info] [Task Finished] Transform to mem in 0.279691s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:50:55.944] [driver] [info] [Task Finished] Transform to mem in 0.277997s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:50:56.223] [driver] [info] [Task Finished] Transform to mem in 0.278364s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:50:56.501] [driver] [info] [Task Finished] Transform to mem in 0.278486s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:50:56.781] [driver] [info] [Task Finished] Transform to mem in 0.279293s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:50:57.060] [driver] [info] [Task Finished] Transform to mem in 0.279491s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:50:57.339] [driver] [info] [Task Finished] Transform to mem in 0.278405s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:50:57.618] [driver] [info] [Task Finished] Transform to mem in 0.279020s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:50:57.896] [driver] [info] [Task Finished] Transform to mem in 0.278484s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:50:58.175] [driver] [info] [Task Finished] Transform to mem in 0.278930s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:50:58.453] [driver] [info] [Task Finished] Transform to mem in 0.278219s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:50:58.732] [driver] [info] [Task Finished] Transform to mem in 0.279112s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:50:59.011] [driver] [info] [Task Finished] Transform to mem in 0.278701s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:50:59.290] [driver] [info] [Task Finished] Transform to mem in 0.278880s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:50:59.568] [driver] [info] [Task Finished] Transform to mem in 0.278159s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:50:59.847] [driver] [info] [Task Finished] Transform to mem in 0.278852s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:51:00.126] [driver] [info] [Task Finished] Transform to mem in 0.278446s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:51:00.406] [driver] [info] [Task Finished] Transform to mem in 0.280159s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:51:00.684] [driver] [info] [Task Finished] Transform to mem in 0.278410s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:51:00.963] [driver] [info] [Task Finished] Transform to mem in 0.278909s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:51:01.242] [driver] [info] [Task Finished] Transform to mem in 0.278590s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:51:01.521] [driver] [info] [Task Finished] Transform to mem in 0.278838s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:51:01.799] [driver] [info] [Task Finished] Transform to mem in 0.278657s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:51:02.079] [driver] [info] [Task Finished] Transform to mem in 0.279311s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:51:02.357] [driver] [info] [Task Finished] Transform to mem in 0.278332s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:51:02.636] [driver] [info] [Task Finished] Transform to mem in 0.278700s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:51:02.914] [driver] [info] [Task Finished] Transform to mem in 0.278414s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:51:03.193] [driver] [info] [Task Finished] Transform to mem in 0.278837s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:51:03.472] [driver] [info] [Task Finished] Transform to mem in 0.278633s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:51:03.751] [driver] [info] [Task Finished] Transform to mem in 0.279007s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:51:04.029] [driver] [info] [Task Finished] Transform to mem in 0.278536s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:51:04.309] [driver] [info] [Task Finished] Transform to mem in 0.279355s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:51:04.587] [driver] [info] [Task Finished] Transform to mem in 0.278133s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:51:04.865] [driver] [info] [Task Finished] Transform to mem in 0.278828s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:51:05.144] [driver] [info] [Task Finished] Transform to mem in 0.278089s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:51:05.422] [driver] [info] [Task Finished] Transform to mem in 0.278534s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:51:05.701] [driver] [info] [Task Finished] Transform to mem in 0.278726s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:51:05.980] [driver] [info] [Task Finished] Transform to mem in 0.278965s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:51:06.258] [driver] [info] [Task Finished] Transform to mem in 0.278246s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:51:06.538] [driver] [info] [Task Finished] Transform to mem in 0.279456s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:51:06.817] [driver] [info] [Task Finished] Transform to mem in 0.278885s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:51:07.095] [driver] [info] [Task Finished] Transform to mem in 0.278896s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:51:07.374] [driver] [info] [Task Finished] Transform to mem in 0.278634s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:51:07.653] [driver] [info] [Task Finished] Transform to mem in 0.279173s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:51:07.933] [driver] [info] [Task Finished] Transform to mem in 0.279330s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:51:08.211] [driver] [info] [Task Finished] Transform to mem in 0.278663s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:51:08.489] [driver] [info] [Task Finished] Transform to mem in 0.278039s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:51:08.768] [driver] [info] [Task Finished] Transform to mem in 0.279086s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:51:09.047] [driver] [info] [Task Finished] Transform to mem in 0.278503s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:51:09.325] [driver] [info] [Task Finished] Transform to mem in 0.278428s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:51:09.604] [driver] [info] [Task Finished] Transform to mem in 0.278188s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:51:09.882] [driver] [info] [Task Finished] Transform to mem in 0.278814s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:51:10.161] [driver] [info] [Task Finished] Transform to mem in 0.278968s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:51:10.440] [driver] [info] [Task Finished] Transform to mem in 0.278269s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:51:10.718] [driver] [info] [Task Finished] Transform to mem in 0.278611s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:51:10.997] [driver] [info] [Task Finished] Transform to mem in 0.278939s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:51:11.276] [driver] [info] [Task Finished] Transform to mem in 0.278469s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:51:11.555] [driver] [info] [Task Finished] Transform to mem in 0.278876s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:51:11.833] [driver] [info] [Task Finished] Transform to mem in 0.278541s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:51:12.112] [driver] [info] [Task Finished] Transform to mem in 0.278771s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:51:12.391] [driver] [info] [Task Finished] Transform to mem in 0.278761s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:51:12.670] [driver] [info] [Task Finished] Transform to mem in 0.278733s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:51:12.948] [driver] [info] [Task Finished] Transform to mem in 0.278720s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:51:13.228] [driver] [info] [Task Finished] Transform to mem in 0.279291s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:51:13.506] [driver] [info] [Task Finished] Transform to mem in 0.278780s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:51:13.785] [driver] [info] [Task Finished] Transform to mem in 0.278963s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:51:14.064] [driver] [info] [Task Finished] Transform to mem in 0.278422s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:51:14.342] [driver] [info] [Task Finished] Transform to mem in 0.278470s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:51:14.621] [driver] [info] [Task Finished] Transform to mem in 0.279150s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:51:14.901] [driver] [info] [Task Finished] Transform to mem in 0.279095s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:51:15.179] [driver] [info] [Task Finished] Transform to mem in 0.278505s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:51:15.459] [driver] [info] [Task Finished] Transform to mem in 0.279495s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:51:15.737] [driver] [info] [Task Finished] Transform to mem in 0.278674s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:51:16.016] [driver] [info] [Task Finished] Transform to mem in 0.278359s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:51:16.294] [driver] [info] [Task Finished] Transform to mem in 0.278632s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:51:16.573] [driver] [info] [Task Finished] Transform to mem in 0.278715s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:51:16.852] [driver] [info] [Task Finished] Transform to mem in 0.279084s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:51:17.131] [driver] [info] [Task Finished] Transform to mem in 0.278638s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:51:17.409] [driver] [info] [Task Finished] Transform to mem in 0.278280s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:51:17.688] [driver] [info] [Task Finished] Transform to mem in 0.278898s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:51:17.967] [driver] [info] [Task Finished] Transform to mem in 0.278654s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:51:18.245] [driver] [info] [Task Finished] Transform to mem in 0.278639s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:51:18.524] [driver] [info] [Task Finished] Transform to mem in 0.278734s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:51:18.802] [driver] [info] [Task Finished] Transform to mem in 0.278165s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:51:19.081] [driver] [info] [Task Finished] Transform to mem in 0.278767s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:51:19.360] [driver] [info] [Task Finished] Transform to mem in 0.278388s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:51:19.638] [driver] [info] [Task Finished] Transform to mem in 0.278275s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:51:19.917] [driver] [info] [Task Finished] Transform to mem in 0.278987s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:51:20.195] [driver] [info] [Task Finished] Transform to mem in 0.278302s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:51:20.473] [driver] [info] [Task Finished] Transform to mem in 0.278199s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:51:20.751] [driver] [info] [Task Finished] Transform to mem in 0.277936s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:51:21.030] [driver] [info] [Task Finished] Transform to mem in 0.278371s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:51:21.309] [driver] [info] [Task Finished] Transform to mem in 0.279191s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:51:21.587] [driver] [info] [Task Finished] Transform to mem in 0.278327s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:51:21.866] [driver] [info] [Task Finished] Transform to mem in 0.279099s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:51:22.146] [driver] [info] [Task Finished] Transform to mem in 0.279172s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:51:22.425] [driver] [info] [Task Finished] Transform to mem in 0.279101s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:51:22.705] [driver] [info] [Task Finished] Transform to mem in 0.279869s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:51:22.983] [driver] [info] [Task Finished] Transform to mem in 0.278128s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:51:23.261] [driver] [info] [Task Finished] Transform to mem in 0.278093s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:51:23.540] [driver] [info] [Task Finished] Transform to mem in 0.279127s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:51:23.817] [driver] [info] [Task Finished] Transform to mem in 0.277435s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:51:24.096] [driver] [info] [Task Finished] Transform to mem in 0.279004s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:51:24.375] [driver] [info] [Task Finished] Transform to mem in 0.278696s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:51:24.654] [driver] [info] [Task Finished] Transform to mem in 0.279235s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:51:24.933] [driver] [info] [Task Finished] Transform to mem in 0.278920s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:51:25.212] [driver] [info] [Task Finished] Transform to mem in 0.279145s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:51:25.492] [driver] [info] [Task Finished] Transform to mem in 0.279303s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:51:25.772] [driver] [info] [Task Finished] Transform to mem in 0.280009s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:51:26.055] [driver] [info] [Task Finished] Transform to mem in 0.283647s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:51:26.335] [driver] [info] [Task Finished] Transform to mem in 0.279707s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:51:26.615] [driver] [info] [Task Finished] Transform to mem in 0.280069s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:51:26.895] [driver] [info] [Task Finished] Transform to mem in 0.279542s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:51:27.175] [driver] [info] [Task Finished] Transform to mem in 0.279917s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:51:27.454] [driver] [info] [Task Finished] Transform to mem in 0.279099s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:51:27.733] [driver] [info] [Task Finished] Transform to mem in 0.279048s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:51:28.013] [driver] [info] [Task Finished] Transform to mem in 0.279942s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:51:28.292] [driver] [info] [Task Finished] Transform to mem in 0.279349s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:51:28.572] [driver] [info] [Task Finished] Transform to mem in 0.279614s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:51:28.851] [driver] [info] [Task Finished] Transform to mem in 0.279345s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:51:29.130] [driver] [info] [Task Finished] Transform to mem in 0.279092s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:51:29.409] [driver] [info] [Task Finished] Transform to mem in 0.278738s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:51:29.688] [driver] [info] [Task Finished] Transform to mem in 0.279144s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:51:29.967] [driver] [info] [Task Finished] Transform to mem in 0.279115s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:51:30.247] [driver] [info] [Task Finished] Transform to mem in 0.279375s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:51:30.526] [driver] [info] [Task Finished] Transform to mem in 0.279067s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:51:30.806] [driver] [info] [Task Finished] Transform to mem in 0.280025s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:51:31.085] [driver] [info] [Task Finished] Transform to mem in 0.279343s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:51:31.364] [driver] [info] [Task Finished] Transform to mem in 0.279020s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:51:31.643] [driver] [info] [Task Finished] Transform to mem in 0.278633s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:51:31.922] [driver] [info] [Task Finished] Transform to mem in 0.278639s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:51:32.201] [driver] [info] [Task Finished] Transform to mem in 0.278801s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:51:32.480] [driver] [info] [Task Finished] Transform to mem in 0.279258s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:51:32.759] [driver] [info] [Task Finished] Transform to mem in 0.279435s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:51:33.038] [driver] [info] [Task Finished] Transform to mem in 0.278503s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:51:33.317] [driver] [info] [Task Finished] Transform to mem in 0.279273s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:51:33.596] [driver] [info] [Task Finished] Transform to mem in 0.278850s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:51:33.875] [driver] [info] [Task Finished] Transform to mem in 0.279188s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:51:34.155] [driver] [info] [Task Finished] Transform to mem in 0.279358s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:51:34.434] [driver] [info] [Task Finished] Transform to mem in 0.279265s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:51:34.713] [driver] [info] [Task Finished] Transform to mem in 0.279219s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:51:34.993] [driver] [info] [Task Finished] Transform to mem in 0.280215s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:51:35.274] [driver] [info] [Task Finished] Transform to mem in 0.280750s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:51:35.554] [driver] [info] [Task Finished] Transform to mem in 0.279992s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:51:35.834] [driver] [info] [Task Finished] Transform to mem in 0.279909s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:51:36.113] [driver] [info] [Task Finished] Transform to mem in 0.279280s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:51:36.392] [driver] [info] [Task Finished] Transform to mem in 0.279155s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:51:36.672] [driver] [info] [Task Finished] Transform to mem in 0.279599s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:51:36.951] [driver] [info] [Task Finished] Transform to mem in 0.279401s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:51:37.231] [driver] [info] [Task Finished] Transform to mem in 0.279988s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:51:37.511] [driver] [info] [Task Finished] Transform to mem in 0.279727s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:51:37.791] [driver] [info] [Task Finished] Transform to mem in 0.279512s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:51:38.074] [driver] [info] [Task Finished] Transform to mem in 0.282925s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:51:38.354] [driver] [info] [Task Finished] Transform to mem in 0.280109s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:51:38.667] [driver] [info] [Task Finished] Transform to mem in 0.312925s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:51:38.667] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.6809s
[2021-03-25 10:51:38.667] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.6777s, 56350770 input rows, time to process 1 row via fast path: 0.000792849ms
[2021-03-25 10:51:38.667] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:51:38.671] [local ee] [info] compiled pure python pipeline in 0.004247s
[2021-03-25 10:51:38.671] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:51:38.672] [local ee] [info] Created 160 resolve tasks in 0.001184s
[2021-03-25 10:51:38.672] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:51:38.685] [driver] [info] [Task Finished] Resolve in 0.012533s
[2021-03-25 10:51:38.697] [driver] [info] [Task Finished] Resolve in 0.012370s
[2021-03-25 10:51:38.710] [driver] [info] [Task Finished] Resolve in 0.012396s
[2021-03-25 10:51:38.722] [driver] [info] [Task Finished] Resolve in 0.012277s
[2021-03-25 10:51:38.734] [driver] [info] [Task Finished] Resolve in 0.012256s
[2021-03-25 10:51:38.747] [driver] [info] [Task Finished] Resolve in 0.012190s
[2021-03-25 10:51:38.759] [driver] [info] [Task Finished] Resolve in 0.012513s
[2021-03-25 10:51:38.771] [driver] [info] [Task Finished] Resolve in 0.012145s
[2021-03-25 10:51:38.784] [driver] [info] [Task Finished] Resolve in 0.012289s
[2021-03-25 10:51:38.796] [driver] [info] [Task Finished] Resolve in 0.012407s
[2021-03-25 10:51:38.808] [driver] [info] [Task Finished] Resolve in 0.012335s
[2021-03-25 10:51:38.821] [driver] [info] [Task Finished] Resolve in 0.012292s
[2021-03-25 10:51:38.833] [driver] [info] [Task Finished] Resolve in 0.012247s
[2021-03-25 10:51:38.845] [driver] [info] [Task Finished] Resolve in 0.012223s
[2021-03-25 10:51:38.857] [driver] [info] [Task Finished] Resolve in 0.012297s
[2021-03-25 10:51:38.870] [driver] [info] [Task Finished] Resolve in 0.012312s
[2021-03-25 10:51:38.882] [driver] [info] [Task Finished] Resolve in 0.012293s
[2021-03-25 10:51:38.894] [driver] [info] [Task Finished] Resolve in 0.012406s
[2021-03-25 10:51:38.907] [driver] [info] [Task Finished] Resolve in 0.012225s
[2021-03-25 10:51:38.919] [driver] [info] [Task Finished] Resolve in 0.012460s
[2021-03-25 10:51:38.931] [driver] [info] [Task Finished] Resolve in 0.012273s
[2021-03-25 10:51:38.944] [driver] [info] [Task Finished] Resolve in 0.012215s
[2021-03-25 10:51:38.956] [driver] [info] [Task Finished] Resolve in 0.012279s
[2021-03-25 10:51:38.968] [driver] [info] [Task Finished] Resolve in 0.012326s
[2021-03-25 10:51:38.981] [driver] [info] [Task Finished] Resolve in 0.012310s
[2021-03-25 10:51:38.993] [driver] [info] [Task Finished] Resolve in 0.012405s
[2021-03-25 10:51:39.005] [driver] [info] [Task Finished] Resolve in 0.012206s
[2021-03-25 10:51:39.018] [driver] [info] [Task Finished] Resolve in 0.012304s
[2021-03-25 10:51:39.030] [driver] [info] [Task Finished] Resolve in 0.012409s
[2021-03-25 10:51:39.042] [driver] [info] [Task Finished] Resolve in 0.012204s
[2021-03-25 10:51:39.055] [driver] [info] [Task Finished] Resolve in 0.012273s
[2021-03-25 10:51:39.067] [driver] [info] [Task Finished] Resolve in 0.012151s
[2021-03-25 10:51:39.079] [driver] [info] [Task Finished] Resolve in 0.012398s
[2021-03-25 10:51:39.092] [driver] [info] [Task Finished] Resolve in 0.012424s
[2021-03-25 10:51:39.104] [driver] [info] [Task Finished] Resolve in 0.012187s
[2021-03-25 10:51:39.116] [driver] [info] [Task Finished] Resolve in 0.012269s
[2021-03-25 10:51:39.128] [driver] [info] [Task Finished] Resolve in 0.012431s
[2021-03-25 10:51:39.141] [driver] [info] [Task Finished] Resolve in 0.012258s
[2021-03-25 10:51:39.153] [driver] [info] [Task Finished] Resolve in 0.012299s
[2021-03-25 10:51:39.165] [driver] [info] [Task Finished] Resolve in 0.012176s
[2021-03-25 10:51:39.178] [driver] [info] [Task Finished] Resolve in 0.012230s
[2021-03-25 10:51:39.190] [driver] [info] [Task Finished] Resolve in 0.012619s
[2021-03-25 10:51:39.202] [driver] [info] [Task Finished] Resolve in 0.012193s
[2021-03-25 10:51:39.215] [driver] [info] [Task Finished] Resolve in 0.012253s
[2021-03-25 10:51:39.227] [driver] [info] [Task Finished] Resolve in 0.012236s
[2021-03-25 10:51:39.239] [driver] [info] [Task Finished] Resolve in 0.012391s
[2021-03-25 10:51:39.252] [driver] [info] [Task Finished] Resolve in 0.012252s
[2021-03-25 10:51:39.264] [driver] [info] [Task Finished] Resolve in 0.012180s
[2021-03-25 10:51:39.276] [driver] [info] [Task Finished] Resolve in 0.012229s
[2021-03-25 10:51:39.289] [driver] [info] [Task Finished] Resolve in 0.012619s
[2021-03-25 10:51:39.301] [driver] [info] [Task Finished] Resolve in 0.012210s
[2021-03-25 10:51:39.313] [driver] [info] [Task Finished] Resolve in 0.012220s
[2021-03-25 10:51:39.325] [driver] [info] [Task Finished] Resolve in 0.012267s
[2021-03-25 10:51:39.338] [driver] [info] [Task Finished] Resolve in 0.012256s
[2021-03-25 10:51:39.350] [driver] [info] [Task Finished] Resolve in 0.012403s
[2021-03-25 10:51:39.362] [driver] [info] [Task Finished] Resolve in 0.012194s
[2021-03-25 10:51:39.374] [driver] [info] [Task Finished] Resolve in 0.012149s
[2021-03-25 10:51:39.387] [driver] [info] [Task Finished] Resolve in 0.012440s
[2021-03-25 10:51:39.399] [driver] [info] [Task Finished] Resolve in 0.012397s
[2021-03-25 10:51:39.412] [driver] [info] [Task Finished] Resolve in 0.012255s
[2021-03-25 10:51:39.424] [driver] [info] [Task Finished] Resolve in 0.012274s
[2021-03-25 10:51:39.436] [driver] [info] [Task Finished] Resolve in 0.012212s
[2021-03-25 10:51:39.449] [driver] [info] [Task Finished] Resolve in 0.012442s
[2021-03-25 10:51:39.461] [driver] [info] [Task Finished] Resolve in 0.012216s
[2021-03-25 10:51:39.473] [driver] [info] [Task Finished] Resolve in 0.012188s
[2021-03-25 10:51:39.485] [driver] [info] [Task Finished] Resolve in 0.012437s
[2021-03-25 10:51:39.498] [driver] [info] [Task Finished] Resolve in 0.012266s
[2021-03-25 10:51:39.510] [driver] [info] [Task Finished] Resolve in 0.012404s
[2021-03-25 10:51:39.522] [driver] [info] [Task Finished] Resolve in 0.012259s
[2021-03-25 10:51:39.535] [driver] [info] [Task Finished] Resolve in 0.012224s
[2021-03-25 10:51:39.547] [driver] [info] [Task Finished] Resolve in 0.012229s
[2021-03-25 10:51:39.559] [driver] [info] [Task Finished] Resolve in 0.012385s
[2021-03-25 10:51:39.571] [driver] [info] [Task Finished] Resolve in 0.012144s
[2021-03-25 10:51:39.584] [driver] [info] [Task Finished] Resolve in 0.012447s
[2021-03-25 10:51:39.596] [driver] [info] [Task Finished] Resolve in 0.012217s
[2021-03-25 10:51:39.608] [driver] [info] [Task Finished] Resolve in 0.012376s
[2021-03-25 10:51:39.621] [driver] [info] [Task Finished] Resolve in 0.012310s
[2021-03-25 10:51:39.633] [driver] [info] [Task Finished] Resolve in 0.012216s
[2021-03-25 10:51:39.645] [driver] [info] [Task Finished] Resolve in 0.012266s
[2021-03-25 10:51:39.658] [driver] [info] [Task Finished] Resolve in 0.012277s
[2021-03-25 10:51:39.670] [driver] [info] [Task Finished] Resolve in 0.012292s
[2021-03-25 10:51:39.682] [driver] [info] [Task Finished] Resolve in 0.012468s
[2021-03-25 10:51:39.695] [driver] [info] [Task Finished] Resolve in 0.012197s
[2021-03-25 10:51:39.707] [driver] [info] [Task Finished] Resolve in 0.012205s
[2021-03-25 10:51:39.719] [driver] [info] [Task Finished] Resolve in 0.012483s
[2021-03-25 10:51:39.732] [driver] [info] [Task Finished] Resolve in 0.012218s
[2021-03-25 10:51:39.744] [driver] [info] [Task Finished] Resolve in 0.012224s
[2021-03-25 10:51:39.756] [driver] [info] [Task Finished] Resolve in 0.012234s
[2021-03-25 10:51:39.768] [driver] [info] [Task Finished] Resolve in 0.012303s
[2021-03-25 10:51:39.781] [driver] [info] [Task Finished] Resolve in 0.012530s
[2021-03-25 10:51:39.793] [driver] [info] [Task Finished] Resolve in 0.012210s
[2021-03-25 10:51:39.805] [driver] [info] [Task Finished] Resolve in 0.012173s
[2021-03-25 10:51:39.818] [driver] [info] [Task Finished] Resolve in 0.012385s
[2021-03-25 10:51:39.830] [driver] [info] [Task Finished] Resolve in 0.012369s
[2021-03-25 10:51:39.842] [driver] [info] [Task Finished] Resolve in 0.012168s
[2021-03-25 10:51:39.855] [driver] [info] [Task Finished] Resolve in 0.012259s
[2021-03-25 10:51:39.867] [driver] [info] [Task Finished] Resolve in 0.012158s
[2021-03-25 10:51:39.879] [driver] [info] [Task Finished] Resolve in 0.012632s
[2021-03-25 10:51:39.892] [driver] [info] [Task Finished] Resolve in 0.012208s
[2021-03-25 10:51:39.904] [driver] [info] [Task Finished] Resolve in 0.012207s
[2021-03-25 10:51:39.916] [driver] [info] [Task Finished] Resolve in 0.012288s
[2021-03-25 10:51:39.928] [driver] [info] [Task Finished] Resolve in 0.012390s
[2021-03-25 10:51:39.941] [driver] [info] [Task Finished] Resolve in 0.012154s
[2021-03-25 10:51:39.953] [driver] [info] [Task Finished] Resolve in 0.012269s
[2021-03-25 10:51:39.965] [driver] [info] [Task Finished] Resolve in 0.012133s
[2021-03-25 10:51:39.978] [driver] [info] [Task Finished] Resolve in 0.012497s
[2021-03-25 10:51:39.990] [driver] [info] [Task Finished] Resolve in 0.012369s
[2021-03-25 10:51:40.002] [driver] [info] [Task Finished] Resolve in 0.012201s
[2021-03-25 10:51:40.014] [driver] [info] [Task Finished] Resolve in 0.012293s
[2021-03-25 10:51:40.027] [driver] [info] [Task Finished] Resolve in 0.012324s
[2021-03-25 10:51:40.039] [driver] [info] [Task Finished] Resolve in 0.012385s
[2021-03-25 10:51:40.052] [driver] [info] [Task Finished] Resolve in 0.012298s
[2021-03-25 10:51:40.064] [driver] [info] [Task Finished] Resolve in 0.012136s
[2021-03-25 10:51:40.076] [driver] [info] [Task Finished] Resolve in 0.012441s
[2021-03-25 10:51:40.089] [driver] [info] [Task Finished] Resolve in 0.012393s
[2021-03-25 10:51:40.101] [driver] [info] [Task Finished] Resolve in 0.012264s
[2021-03-25 10:51:40.113] [driver] [info] [Task Finished] Resolve in 0.012309s
[2021-03-25 10:51:40.125] [driver] [info] [Task Finished] Resolve in 0.012204s
[2021-03-25 10:51:40.138] [driver] [info] [Task Finished] Resolve in 0.012244s
[2021-03-25 10:51:40.150] [driver] [info] [Task Finished] Resolve in 0.012460s
[2021-03-25 10:51:40.162] [driver] [info] [Task Finished] Resolve in 0.012138s
[2021-03-25 10:51:40.175] [driver] [info] [Task Finished] Resolve in 0.012439s
[2021-03-25 10:51:40.187] [driver] [info] [Task Finished] Resolve in 0.012213s
[2021-03-25 10:51:40.199] [driver] [info] [Task Finished] Resolve in 0.012407s
[2021-03-25 10:51:40.212] [driver] [info] [Task Finished] Resolve in 0.012284s
[2021-03-25 10:51:40.224] [driver] [info] [Task Finished] Resolve in 0.012186s
[2021-03-25 10:51:40.236] [driver] [info] [Task Finished] Resolve in 0.012188s
[2021-03-25 10:51:40.248] [driver] [info] [Task Finished] Resolve in 0.012454s
[2021-03-25 10:51:40.261] [driver] [info] [Task Finished] Resolve in 0.012150s
[2021-03-25 10:51:40.273] [driver] [info] [Task Finished] Resolve in 0.012473s
[2021-03-25 10:51:40.285] [driver] [info] [Task Finished] Resolve in 0.012223s
[2021-03-25 10:51:40.298] [driver] [info] [Task Finished] Resolve in 0.012267s
[2021-03-25 10:51:40.310] [driver] [info] [Task Finished] Resolve in 0.012451s
[2021-03-25 10:51:40.322] [driver] [info] [Task Finished] Resolve in 0.012240s
[2021-03-25 10:51:40.335] [driver] [info] [Task Finished] Resolve in 0.012155s
[2021-03-25 10:51:40.347] [driver] [info] [Task Finished] Resolve in 0.012283s
[2021-03-25 10:51:40.359] [driver] [info] [Task Finished] Resolve in 0.012358s
[2021-03-25 10:51:40.372] [driver] [info] [Task Finished] Resolve in 0.012387s
[2021-03-25 10:51:40.384] [driver] [info] [Task Finished] Resolve in 0.012266s
[2021-03-25 10:51:40.396] [driver] [info] [Task Finished] Resolve in 0.012214s
[2021-03-25 10:51:40.409] [driver] [info] [Task Finished] Resolve in 0.012483s
[2021-03-25 10:51:40.421] [driver] [info] [Task Finished] Resolve in 0.012208s
[2021-03-25 10:51:40.433] [driver] [info] [Task Finished] Resolve in 0.012177s
[2021-03-25 10:51:40.445] [driver] [info] [Task Finished] Resolve in 0.012293s
[2021-03-25 10:51:40.458] [driver] [info] [Task Finished] Resolve in 0.012198s
[2021-03-25 10:51:40.470] [driver] [info] [Task Finished] Resolve in 0.012537s
[2021-03-25 10:51:40.482] [driver] [info] [Task Finished] Resolve in 0.012296s
[2021-03-25 10:51:40.495] [driver] [info] [Task Finished] Resolve in 0.012215s
[2021-03-25 10:51:40.507] [driver] [info] [Task Finished] Resolve in 0.012271s
[2021-03-25 10:51:40.519] [driver] [info] [Task Finished] Resolve in 0.012417s
[2021-03-25 10:51:40.532] [driver] [info] [Task Finished] Resolve in 0.012204s
[2021-03-25 10:51:40.544] [driver] [info] [Task Finished] Resolve in 0.012283s
[2021-03-25 10:51:40.556] [driver] [info] [Task Finished] Resolve in 0.012140s
[2021-03-25 10:51:40.569] [driver] [info] [Task Finished] Resolve in 0.012526s
[2021-03-25 10:51:40.581] [driver] [info] [Task Finished] Resolve in 0.012304s
[2021-03-25 10:51:40.593] [driver] [info] [Task Finished] Resolve in 0.012252s
[2021-03-25 10:51:40.605] [driver] [info] [Task Finished] Resolve in 0.012273s
[2021-03-25 10:51:40.618] [driver] [info] [Task Finished] Resolve in 0.012280s
[2021-03-25 10:51:40.630] [driver] [info] [Task Finished] Resolve in 0.012329s
[2021-03-25 10:51:40.644] [driver] [info] [Task Finished] Resolve in 0.013624s
[2021-03-25 10:51:40.644] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 1.97694s
[2021-03-25 10:51:40.644] [local ee] [info] slow path for Stage 0: total wall clock time: 1.9691s, time to process 1 row via slow path: 0.000285546ms
[2021-03-25 10:51:40.644] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.97696s

[2021-03-25 10:51:40.677] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:51:40.991] [driver] [info] [Task Finished] write to file in 0.313691s (1798491 rows, 273.80 MB)
[2021-03-25 10:51:40.991] [global] [info] writing output took 0.346808s
[2021-03-25 10:51:40.991] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.346894s
[2021-03-25 10:51:40.991] [global] [info] [Transform Stage] Stage 0 took 47.5063s
[2021-03-25 10:51:40.991] [global] [info] Query Execution took 47.5849s. (planning: 0.0785327s, execution: 47.5064s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.0050237178802490234
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 47.8617479801178 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0219166,"llvm_optimization_time_s":0.332417,"llvm_compilation_time_s":0.151812,"total_compilation_time_s":0.501588,"sampling_time_s":0.110086,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.6777,"fast_path_time_s":44.6809,"fast_path_per_row_time_ns":792.849,"slow_path_wall_time_s":1.9691,"slow_path_time_s":1.97694,"slow_path_per_row_time_ns":285.546}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.0050237178802490234, "jobTime": 47.8617479801178, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
