[2021-03-25 10:42:47.131] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:42:47.131] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:42:47.131] [local ee] [info] initializing LLVM backend
[2021-03-25 10:42:47.131] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:42:47.131] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:42:47.132] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 10:42:47.132] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:42:47.132] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:42:47.132] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:42:47.266] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:42:47.272] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:42:47.287] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:42:47.295] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:42:47.321] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:42:47.341] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:42:47.354] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:42:47.385] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:42:47.391] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:42:47.407] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:42:47.409] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:42:47.410] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:42:47.410] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:42:47.412] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:42:47.413] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:42:47.413] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:42:47.415] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:42:47.416] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:42:47.416] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:42:47.432] [logical planner] [info] logical optimization took 0.021880ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:42:47.433] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:42:47.433] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:42:47.434] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:42:47.434] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:42:47.435] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:42:47.436] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:42:47.436] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:42:47.437] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:42:47.438] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:42:47.439] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:42:47.440] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:42:47.441] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:42:47.441] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:42:47.442] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:42:47.444] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:42:47.444] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:42:47.445] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:42:47.446] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:42:47.446] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:42:47.447] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:42:47.447] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:42:47.448] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:42:47.449] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:42:47.450] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:42:47.451] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:42:47.452] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:42:47.453] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:42:47.453] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:42:47.454] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:42:47.486] [global] [info] Stage0 depends on: 
[2021-03-25 10:42:47.836] [global] [info] Optimization via LLVM passes took 0.332473 ms
[2021-03-25 10:42:47.987] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:42:47.987] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.501014s
[2021-03-25 10:42:47.987] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:42:48.271] [driver] [info] [Task Finished] Transform to mem in 0.283968s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:42:48.553] [driver] [info] [Task Finished] Transform to mem in 0.281628s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:42:48.835] [driver] [info] [Task Finished] Transform to mem in 0.282201s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:42:49.117] [driver] [info] [Task Finished] Transform to mem in 0.282403s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:42:49.399] [driver] [info] [Task Finished] Transform to mem in 0.281612s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:42:49.680] [driver] [info] [Task Finished] Transform to mem in 0.281331s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:42:49.962] [driver] [info] [Task Finished] Transform to mem in 0.281629s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:42:50.244] [driver] [info] [Task Finished] Transform to mem in 0.281729s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:42:50.525] [driver] [info] [Task Finished] Transform to mem in 0.280755s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:42:50.806] [driver] [info] [Task Finished] Transform to mem in 0.281737s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:42:51.088] [driver] [info] [Task Finished] Transform to mem in 0.281671s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:42:51.369] [driver] [info] [Task Finished] Transform to mem in 0.280954s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:42:51.651] [driver] [info] [Task Finished] Transform to mem in 0.281718s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:42:51.932] [driver] [info] [Task Finished] Transform to mem in 0.280931s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:42:52.213] [driver] [info] [Task Finished] Transform to mem in 0.281107s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:42:52.494] [driver] [info] [Task Finished] Transform to mem in 0.281021s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:42:52.775] [driver] [info] [Task Finished] Transform to mem in 0.281209s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:42:53.057] [driver] [info] [Task Finished] Transform to mem in 0.281828s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:42:53.338] [driver] [info] [Task Finished] Transform to mem in 0.281153s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:42:53.619] [driver] [info] [Task Finished] Transform to mem in 0.281327s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:42:53.900] [driver] [info] [Task Finished] Transform to mem in 0.280925s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:42:54.182] [driver] [info] [Task Finished] Transform to mem in 0.281169s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:42:54.462] [driver] [info] [Task Finished] Transform to mem in 0.280752s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:42:54.743] [driver] [info] [Task Finished] Transform to mem in 0.280421s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:42:55.024] [driver] [info] [Task Finished] Transform to mem in 0.281229s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:42:55.306] [driver] [info] [Task Finished] Transform to mem in 0.281926s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:42:55.587] [driver] [info] [Task Finished] Transform to mem in 0.280957s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:42:55.868] [driver] [info] [Task Finished] Transform to mem in 0.281187s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:42:56.149] [driver] [info] [Task Finished] Transform to mem in 0.281355s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:42:56.430] [driver] [info] [Task Finished] Transform to mem in 0.280631s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:42:56.711] [driver] [info] [Task Finished] Transform to mem in 0.280722s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:42:56.992] [driver] [info] [Task Finished] Transform to mem in 0.280695s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:42:57.272] [driver] [info] [Task Finished] Transform to mem in 0.280800s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:42:57.554] [driver] [info] [Task Finished] Transform to mem in 0.281516s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:42:57.835] [driver] [info] [Task Finished] Transform to mem in 0.281354s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:42:58.116] [driver] [info] [Task Finished] Transform to mem in 0.280943s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:42:58.397] [driver] [info] [Task Finished] Transform to mem in 0.281139s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:42:58.678] [driver] [info] [Task Finished] Transform to mem in 0.280834s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:42:58.959] [driver] [info] [Task Finished] Transform to mem in 0.280702s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:42:59.240] [driver] [info] [Task Finished] Transform to mem in 0.280921s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:42:59.521] [driver] [info] [Task Finished] Transform to mem in 0.280925s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:42:59.802] [driver] [info] [Task Finished] Transform to mem in 0.281401s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:43:00.083] [driver] [info] [Task Finished] Transform to mem in 0.281165s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:43:00.365] [driver] [info] [Task Finished] Transform to mem in 0.281269s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:43:00.647] [driver] [info] [Task Finished] Transform to mem in 0.281839s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:43:00.928] [driver] [info] [Task Finished] Transform to mem in 0.281868s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:43:01.209] [driver] [info] [Task Finished] Transform to mem in 0.280851s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:43:01.491] [driver] [info] [Task Finished] Transform to mem in 0.281186s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:43:01.771] [driver] [info] [Task Finished] Transform to mem in 0.280822s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:43:02.053] [driver] [info] [Task Finished] Transform to mem in 0.282025s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:43:02.335] [driver] [info] [Task Finished] Transform to mem in 0.281327s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:43:02.617] [driver] [info] [Task Finished] Transform to mem in 0.282517s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:43:02.899] [driver] [info] [Task Finished] Transform to mem in 0.281812s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:43:03.181] [driver] [info] [Task Finished] Transform to mem in 0.281710s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:43:03.462] [driver] [info] [Task Finished] Transform to mem in 0.281115s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:43:03.743] [driver] [info] [Task Finished] Transform to mem in 0.281079s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:43:04.024] [driver] [info] [Task Finished] Transform to mem in 0.280501s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:43:04.305] [driver] [info] [Task Finished] Transform to mem in 0.281366s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:43:04.587] [driver] [info] [Task Finished] Transform to mem in 0.281759s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:43:04.868] [driver] [info] [Task Finished] Transform to mem in 0.281333s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:43:05.149] [driver] [info] [Task Finished] Transform to mem in 0.280949s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:43:05.431] [driver] [info] [Task Finished] Transform to mem in 0.281788s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:43:05.712] [driver] [info] [Task Finished] Transform to mem in 0.281199s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:43:05.994] [driver] [info] [Task Finished] Transform to mem in 0.281452s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:43:06.275] [driver] [info] [Task Finished] Transform to mem in 0.280922s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:43:06.556] [driver] [info] [Task Finished] Transform to mem in 0.281415s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:43:06.837] [driver] [info] [Task Finished] Transform to mem in 0.281095s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:43:07.118] [driver] [info] [Task Finished] Transform to mem in 0.281360s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:43:07.399] [driver] [info] [Task Finished] Transform to mem in 0.280647s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:43:07.681] [driver] [info] [Task Finished] Transform to mem in 0.281404s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:43:07.961] [driver] [info] [Task Finished] Transform to mem in 0.280875s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:43:08.242] [driver] [info] [Task Finished] Transform to mem in 0.280841s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:43:08.523] [driver] [info] [Task Finished] Transform to mem in 0.280781s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:43:08.804] [driver] [info] [Task Finished] Transform to mem in 0.281339s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:43:09.086] [driver] [info] [Task Finished] Transform to mem in 0.281254s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:43:09.367] [driver] [info] [Task Finished] Transform to mem in 0.280976s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:43:09.648] [driver] [info] [Task Finished] Transform to mem in 0.281140s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:43:09.929] [driver] [info] [Task Finished] Transform to mem in 0.281223s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:43:10.209] [driver] [info] [Task Finished] Transform to mem in 0.280370s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:43:10.491] [driver] [info] [Task Finished] Transform to mem in 0.281539s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:43:10.772] [driver] [info] [Task Finished] Transform to mem in 0.280951s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:43:11.054] [driver] [info] [Task Finished] Transform to mem in 0.281776s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:43:11.335] [driver] [info] [Task Finished] Transform to mem in 0.281093s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:43:11.616] [driver] [info] [Task Finished] Transform to mem in 0.281158s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:43:11.897] [driver] [info] [Task Finished] Transform to mem in 0.280549s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:43:12.177] [driver] [info] [Task Finished] Transform to mem in 0.280676s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:43:12.458] [driver] [info] [Task Finished] Transform to mem in 0.280595s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:43:12.739] [driver] [info] [Task Finished] Transform to mem in 0.281395s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:43:13.020] [driver] [info] [Task Finished] Transform to mem in 0.280399s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:43:13.301] [driver] [info] [Task Finished] Transform to mem in 0.281413s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:43:13.583] [driver] [info] [Task Finished] Transform to mem in 0.281353s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:43:13.864] [driver] [info] [Task Finished] Transform to mem in 0.281341s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:43:14.145] [driver] [info] [Task Finished] Transform to mem in 0.280688s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:43:14.426] [driver] [info] [Task Finished] Transform to mem in 0.281089s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:43:14.707] [driver] [info] [Task Finished] Transform to mem in 0.281241s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:43:14.989] [driver] [info] [Task Finished] Transform to mem in 0.281655s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:43:15.270] [driver] [info] [Task Finished] Transform to mem in 0.281239s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:43:15.552] [driver] [info] [Task Finished] Transform to mem in 0.281882s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:43:15.833] [driver] [info] [Task Finished] Transform to mem in 0.280935s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:43:16.114] [driver] [info] [Task Finished] Transform to mem in 0.281337s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:43:16.395] [driver] [info] [Task Finished] Transform to mem in 0.281106s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:43:16.677] [driver] [info] [Task Finished] Transform to mem in 0.281296s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:43:16.958] [driver] [info] [Task Finished] Transform to mem in 0.280931s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:43:17.239] [driver] [info] [Task Finished] Transform to mem in 0.281118s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:43:17.519] [driver] [info] [Task Finished] Transform to mem in 0.280463s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:43:17.801] [driver] [info] [Task Finished] Transform to mem in 0.281674s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:43:18.083] [driver] [info] [Task Finished] Transform to mem in 0.281622s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:43:18.364] [driver] [info] [Task Finished] Transform to mem in 0.281077s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:43:18.645] [driver] [info] [Task Finished] Transform to mem in 0.280988s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:43:18.926] [driver] [info] [Task Finished] Transform to mem in 0.281487s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:43:19.207] [driver] [info] [Task Finished] Transform to mem in 0.281128s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:43:19.490] [driver] [info] [Task Finished] Transform to mem in 0.282439s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:43:19.771] [driver] [info] [Task Finished] Transform to mem in 0.281192s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:43:20.053] [driver] [info] [Task Finished] Transform to mem in 0.282072s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:43:20.335] [driver] [info] [Task Finished] Transform to mem in 0.281904s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:43:20.617] [driver] [info] [Task Finished] Transform to mem in 0.282234s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:43:20.899] [driver] [info] [Task Finished] Transform to mem in 0.281615s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:43:21.181] [driver] [info] [Task Finished] Transform to mem in 0.282233s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:43:21.463] [driver] [info] [Task Finished] Transform to mem in 0.281715s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:43:21.745] [driver] [info] [Task Finished] Transform to mem in 0.282330s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:43:22.026] [driver] [info] [Task Finished] Transform to mem in 0.281262s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:43:22.312] [driver] [info] [Task Finished] Transform to mem in 0.285454s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:43:22.594] [driver] [info] [Task Finished] Transform to mem in 0.282096s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:43:22.876] [driver] [info] [Task Finished] Transform to mem in 0.282241s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:43:23.158] [driver] [info] [Task Finished] Transform to mem in 0.281939s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:43:23.440] [driver] [info] [Task Finished] Transform to mem in 0.281819s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:43:23.722] [driver] [info] [Task Finished] Transform to mem in 0.281468s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:43:24.003] [driver] [info] [Task Finished] Transform to mem in 0.281832s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:43:24.285] [driver] [info] [Task Finished] Transform to mem in 0.281907s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:43:24.567] [driver] [info] [Task Finished] Transform to mem in 0.281464s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:43:24.848] [driver] [info] [Task Finished] Transform to mem in 0.281386s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:43:25.130] [driver] [info] [Task Finished] Transform to mem in 0.282088s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:43:25.412] [driver] [info] [Task Finished] Transform to mem in 0.281350s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:43:25.694] [driver] [info] [Task Finished] Transform to mem in 0.282101s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:43:25.976] [driver] [info] [Task Finished] Transform to mem in 0.281631s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:43:26.258] [driver] [info] [Task Finished] Transform to mem in 0.282185s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:43:26.539] [driver] [info] [Task Finished] Transform to mem in 0.281382s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:43:26.821] [driver] [info] [Task Finished] Transform to mem in 0.281567s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:43:27.102] [driver] [info] [Task Finished] Transform to mem in 0.281352s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:43:27.384] [driver] [info] [Task Finished] Transform to mem in 0.281474s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:43:27.665] [driver] [info] [Task Finished] Transform to mem in 0.281513s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:43:27.947] [driver] [info] [Task Finished] Transform to mem in 0.281767s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:43:28.228] [driver] [info] [Task Finished] Transform to mem in 0.280935s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:43:28.510] [driver] [info] [Task Finished] Transform to mem in 0.282488s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:43:28.792] [driver] [info] [Task Finished] Transform to mem in 0.282101s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:43:29.074] [driver] [info] [Task Finished] Transform to mem in 0.281863s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:43:29.356] [driver] [info] [Task Finished] Transform to mem in 0.282001s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:43:29.639] [driver] [info] [Task Finished] Transform to mem in 0.282524s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:43:29.920] [driver] [info] [Task Finished] Transform to mem in 0.281298s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:43:30.203] [driver] [info] [Task Finished] Transform to mem in 0.282343s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:43:30.484] [driver] [info] [Task Finished] Transform to mem in 0.281722s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:43:30.766] [driver] [info] [Task Finished] Transform to mem in 0.281678s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:43:31.048] [driver] [info] [Task Finished] Transform to mem in 0.281557s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:43:31.329] [driver] [info] [Task Finished] Transform to mem in 0.281758s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:43:31.611] [driver] [info] [Task Finished] Transform to mem in 0.282037s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:43:31.894] [driver] [info] [Task Finished] Transform to mem in 0.282183s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:43:32.175] [driver] [info] [Task Finished] Transform to mem in 0.281329s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:43:32.457] [driver] [info] [Task Finished] Transform to mem in 0.282337s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:43:32.740] [driver] [info] [Task Finished] Transform to mem in 0.282404s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:43:33.055] [driver] [info] [Task Finished] Transform to mem in 0.315424s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:43:33.055] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 45.0685s
[2021-03-25 10:43:33.055] [global] [info] [Transform Stage] Stage 0 total wall clock time: 45.0652s, 56350770 input rows, time to process 1 row via fast path: 0.000799726ms
[2021-03-25 10:43:33.055] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:43:33.060] [local ee] [info] compiled pure python pipeline in 0.004248s
[2021-03-25 10:43:33.060] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:43:33.061] [local ee] [info] Created 160 resolve tasks in 0.001155s
[2021-03-25 10:43:33.061] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:43:33.073] [driver] [info] [Task Finished] Resolve in 0.012044s
[2021-03-25 10:43:33.085] [driver] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:43:33.097] [driver] [info] [Task Finished] Resolve in 0.011736s
[2021-03-25 10:43:33.109] [driver] [info] [Task Finished] Resolve in 0.011999s
[2021-03-25 10:43:33.120] [driver] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:43:33.132] [driver] [info] [Task Finished] Resolve in 0.011757s
[2021-03-25 10:43:33.144] [driver] [info] [Task Finished] Resolve in 0.011838s
[2021-03-25 10:43:33.156] [driver] [info] [Task Finished] Resolve in 0.011685s
[2021-03-25 10:43:33.168] [driver] [info] [Task Finished] Resolve in 0.011902s
[2021-03-25 10:43:33.180] [driver] [info] [Task Finished] Resolve in 0.012009s
[2021-03-25 10:43:33.192] [driver] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:43:33.203] [driver] [info] [Task Finished] Resolve in 0.011770s
[2021-03-25 10:43:33.215] [driver] [info] [Task Finished] Resolve in 0.011788s
[2021-03-25 10:43:33.227] [driver] [info] [Task Finished] Resolve in 0.011734s
[2021-03-25 10:43:33.239] [driver] [info] [Task Finished] Resolve in 0.012011s
[2021-03-25 10:43:33.251] [driver] [info] [Task Finished] Resolve in 0.011669s
[2021-03-25 10:43:33.262] [driver] [info] [Task Finished] Resolve in 0.011782s
[2021-03-25 10:43:33.274] [driver] [info] [Task Finished] Resolve in 0.011897s
[2021-03-25 10:43:33.286] [driver] [info] [Task Finished] Resolve in 0.011708s
[2021-03-25 10:43:33.298] [driver] [info] [Task Finished] Resolve in 0.011842s
[2021-03-25 10:43:33.310] [driver] [info] [Task Finished] Resolve in 0.011862s
[2021-03-25 10:43:33.321] [driver] [info] [Task Finished] Resolve in 0.011729s
[2021-03-25 10:43:33.333] [driver] [info] [Task Finished] Resolve in 0.011811s
[2021-03-25 10:43:33.345] [driver] [info] [Task Finished] Resolve in 0.011712s
[2021-03-25 10:43:33.357] [driver] [info] [Task Finished] Resolve in 0.011821s
[2021-03-25 10:43:33.369] [driver] [info] [Task Finished] Resolve in 0.012155s
[2021-03-25 10:43:33.381] [driver] [info] [Task Finished] Resolve in 0.011738s
[2021-03-25 10:43:33.393] [driver] [info] [Task Finished] Resolve in 0.011807s
[2021-03-25 10:43:33.404] [driver] [info] [Task Finished] Resolve in 0.011794s
[2021-03-25 10:43:33.416] [driver] [info] [Task Finished] Resolve in 0.011746s
[2021-03-25 10:43:33.428] [driver] [info] [Task Finished] Resolve in 0.011949s
[2021-03-25 10:43:33.440] [driver] [info] [Task Finished] Resolve in 0.011781s
[2021-03-25 10:43:33.452] [driver] [info] [Task Finished] Resolve in 0.011737s
[2021-03-25 10:43:33.464] [driver] [info] [Task Finished] Resolve in 0.011972s
[2021-03-25 10:43:33.475] [driver] [info] [Task Finished] Resolve in 0.011709s
[2021-03-25 10:43:33.487] [driver] [info] [Task Finished] Resolve in 0.011964s
[2021-03-25 10:43:33.499] [driver] [info] [Task Finished] Resolve in 0.011942s
[2021-03-25 10:43:33.511] [driver] [info] [Task Finished] Resolve in 0.011738s
[2021-03-25 10:43:33.523] [driver] [info] [Task Finished] Resolve in 0.011789s
[2021-03-25 10:43:33.535] [driver] [info] [Task Finished] Resolve in 0.011729s
[2021-03-25 10:43:33.546] [driver] [info] [Task Finished] Resolve in 0.011711s
[2021-03-25 10:43:33.559] [driver] [info] [Task Finished] Resolve in 0.012183s
[2021-03-25 10:43:33.570] [driver] [info] [Task Finished] Resolve in 0.011737s
[2021-03-25 10:43:33.582] [driver] [info] [Task Finished] Resolve in 0.011799s
[2021-03-25 10:43:33.594] [driver] [info] [Task Finished] Resolve in 0.011776s
[2021-03-25 10:43:33.606] [driver] [info] [Task Finished] Resolve in 0.011749s
[2021-03-25 10:43:33.617] [driver] [info] [Task Finished] Resolve in 0.011834s
[2021-03-25 10:43:33.629] [driver] [info] [Task Finished] Resolve in 0.011835s
[2021-03-25 10:43:33.641] [driver] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:43:33.653] [driver] [info] [Task Finished] Resolve in 0.011969s
[2021-03-25 10:43:33.665] [driver] [info] [Task Finished] Resolve in 0.011729s
[2021-03-25 10:43:33.677] [driver] [info] [Task Finished] Resolve in 0.011751s
[2021-03-25 10:43:33.689] [driver] [info] [Task Finished] Resolve in 0.011996s
[2021-03-25 10:43:33.700] [driver] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:43:33.712] [driver] [info] [Task Finished] Resolve in 0.011803s
[2021-03-25 10:43:33.724] [driver] [info] [Task Finished] Resolve in 0.011701s
[2021-03-25 10:43:33.736] [driver] [info] [Task Finished] Resolve in 0.011712s
[2021-03-25 10:43:33.748] [driver] [info] [Task Finished] Resolve in 0.012088s
[2021-03-25 10:43:33.760] [driver] [info] [Task Finished] Resolve in 0.011831s
[2021-03-25 10:43:33.771] [driver] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:43:33.783] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:43:33.795] [driver] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:43:33.807] [driver] [info] [Task Finished] Resolve in 0.011794s
[2021-03-25 10:43:33.819] [driver] [info] [Task Finished] Resolve in 0.011882s
[2021-03-25 10:43:33.830] [driver] [info] [Task Finished] Resolve in 0.011690s
[2021-03-25 10:43:33.842] [driver] [info] [Task Finished] Resolve in 0.011969s
[2021-03-25 10:43:33.854] [driver] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:43:33.866] [driver] [info] [Task Finished] Resolve in 0.011786s
[2021-03-25 10:43:33.878] [driver] [info] [Task Finished] Resolve in 0.011954s
[2021-03-25 10:43:33.890] [driver] [info] [Task Finished] Resolve in 0.011852s
[2021-03-25 10:43:33.902] [driver] [info] [Task Finished] Resolve in 0.011779s
[2021-03-25 10:43:33.913] [driver] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:43:33.925] [driver] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:43:33.937] [driver] [info] [Task Finished] Resolve in 0.012014s
[2021-03-25 10:43:33.949] [driver] [info] [Task Finished] Resolve in 0.011936s
[2021-03-25 10:43:33.961] [driver] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:43:33.973] [driver] [info] [Task Finished] Resolve in 0.011809s
[2021-03-25 10:43:33.984] [driver] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:43:33.996] [driver] [info] [Task Finished] Resolve in 0.011768s
[2021-03-25 10:43:34.008] [driver] [info] [Task Finished] Resolve in 0.011847s
[2021-03-25 10:43:34.020] [driver] [info] [Task Finished] Resolve in 0.011988s
[2021-03-25 10:43:34.032] [driver] [info] [Task Finished] Resolve in 0.011965s
[2021-03-25 10:43:34.044] [driver] [info] [Task Finished] Resolve in 0.011717s
[2021-03-25 10:43:34.055] [driver] [info] [Task Finished] Resolve in 0.011714s
[2021-03-25 10:43:34.067] [driver] [info] [Task Finished] Resolve in 0.011861s
[2021-03-25 10:43:34.079] [driver] [info] [Task Finished] Resolve in 0.011874s
[2021-03-25 10:43:34.091] [driver] [info] [Task Finished] Resolve in 0.011756s
[2021-03-25 10:43:34.103] [driver] [info] [Task Finished] Resolve in 0.011771s
[2021-03-25 10:43:34.115] [driver] [info] [Task Finished] Resolve in 0.011698s
[2021-03-25 10:43:34.127] [driver] [info] [Task Finished] Resolve in 0.011986s
[2021-03-25 10:43:34.138] [driver] [info] [Task Finished] Resolve in 0.011938s
[2021-03-25 10:43:34.150] [driver] [info] [Task Finished] Resolve in 0.011733s
[2021-03-25 10:43:34.162] [driver] [info] [Task Finished] Resolve in 0.011845s
[2021-03-25 10:43:34.174] [driver] [info] [Task Finished] Resolve in 0.011759s
[2021-03-25 10:43:34.186] [driver] [info] [Task Finished] Resolve in 0.011708s
[2021-03-25 10:43:34.197] [driver] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:43:34.209] [driver] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:43:34.221] [driver] [info] [Task Finished] Resolve in 0.011984s
[2021-03-25 10:43:34.233] [driver] [info] [Task Finished] Resolve in 0.011749s
[2021-03-25 10:43:34.245] [driver] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:43:34.257] [driver] [info] [Task Finished] Resolve in 0.011813s
[2021-03-25 10:43:34.269] [driver] [info] [Task Finished] Resolve in 0.011978s
[2021-03-25 10:43:34.280] [driver] [info] [Task Finished] Resolve in 0.011676s
[2021-03-25 10:43:34.292] [driver] [info] [Task Finished] Resolve in 0.011794s
[2021-03-25 10:43:34.304] [driver] [info] [Task Finished] Resolve in 0.011674s
[2021-03-25 10:43:34.316] [driver] [info] [Task Finished] Resolve in 0.011943s
[2021-03-25 10:43:34.328] [driver] [info] [Task Finished] Resolve in 0.011790s
[2021-03-25 10:43:34.339] [driver] [info] [Task Finished] Resolve in 0.011852s
[2021-03-25 10:43:34.351] [driver] [info] [Task Finished] Resolve in 0.011807s
[2021-03-25 10:43:34.363] [driver] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:43:34.375] [driver] [info] [Task Finished] Resolve in 0.011706s
[2021-03-25 10:43:34.387] [driver] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:43:34.398] [driver] [info] [Task Finished] Resolve in 0.011824s
[2021-03-25 10:43:34.410] [driver] [info] [Task Finished] Resolve in 0.011974s
[2021-03-25 10:43:34.422] [driver] [info] [Task Finished] Resolve in 0.011748s
[2021-03-25 10:43:34.434] [driver] [info] [Task Finished] Resolve in 0.011737s
[2021-03-25 10:43:34.446] [driver] [info] [Task Finished] Resolve in 0.011784s
[2021-03-25 10:43:34.458] [driver] [info] [Task Finished] Resolve in 0.011799s
[2021-03-25 10:43:34.469] [driver] [info] [Task Finished] Resolve in 0.011815s
[2021-03-25 10:43:34.481] [driver] [info] [Task Finished] Resolve in 0.011818s
[2021-03-25 10:43:34.493] [driver] [info] [Task Finished] Resolve in 0.011747s
[2021-03-25 10:43:34.505] [driver] [info] [Task Finished] Resolve in 0.011976s
[2021-03-25 10:43:34.517] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:43:34.529] [driver] [info] [Task Finished] Resolve in 0.011956s
[2021-03-25 10:43:34.541] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:43:34.552] [driver] [info] [Task Finished] Resolve in 0.011760s
[2021-03-25 10:43:34.564] [driver] [info] [Task Finished] Resolve in 0.011711s
[2021-03-25 10:43:34.576] [driver] [info] [Task Finished] Resolve in 0.011822s
[2021-03-25 10:43:34.588] [driver] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:43:34.600] [driver] [info] [Task Finished] Resolve in 0.012092s
[2021-03-25 10:43:34.612] [driver] [info] [Task Finished] Resolve in 0.011764s
[2021-03-25 10:43:34.623] [driver] [info] [Task Finished] Resolve in 0.011738s
[2021-03-25 10:43:34.635] [driver] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:43:34.647] [driver] [info] [Task Finished] Resolve in 0.011742s
[2021-03-25 10:43:34.659] [driver] [info] [Task Finished] Resolve in 0.011916s
[2021-03-25 10:43:34.671] [driver] [info] [Task Finished] Resolve in 0.011813s
[2021-03-25 10:43:34.682] [driver] [info] [Task Finished] Resolve in 0.011680s
[2021-03-25 10:43:34.694] [driver] [info] [Task Finished] Resolve in 0.011949s
[2021-03-25 10:43:34.706] [driver] [info] [Task Finished] Resolve in 0.011773s
[2021-03-25 10:43:34.718] [driver] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:43:34.730] [driver] [info] [Task Finished] Resolve in 0.011855s
[2021-03-25 10:43:34.742] [driver] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:43:34.753] [driver] [info] [Task Finished] Resolve in 0.011709s
[2021-03-25 10:43:34.765] [driver] [info] [Task Finished] Resolve in 0.011824s
[2021-03-25 10:43:34.777] [driver] [info] [Task Finished] Resolve in 0.011677s
[2021-03-25 10:43:34.789] [driver] [info] [Task Finished] Resolve in 0.012088s
[2021-03-25 10:43:34.801] [driver] [info] [Task Finished] Resolve in 0.011812s
[2021-03-25 10:43:34.813] [driver] [info] [Task Finished] Resolve in 0.011742s
[2021-03-25 10:43:34.824] [driver] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:43:34.836] [driver] [info] [Task Finished] Resolve in 0.011748s
[2021-03-25 10:43:34.848] [driver] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:43:34.860] [driver] [info] [Task Finished] Resolve in 0.011865s
[2021-03-25 10:43:34.872] [driver] [info] [Task Finished] Resolve in 0.011676s
[2021-03-25 10:43:34.883] [driver] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:43:34.895] [driver] [info] [Task Finished] Resolve in 0.011834s
[2021-03-25 10:43:34.907] [driver] [info] [Task Finished] Resolve in 0.011755s
[2021-03-25 10:43:34.919] [driver] [info] [Task Finished] Resolve in 0.011996s
[2021-03-25 10:43:34.931] [driver] [info] [Task Finished] Resolve in 0.011737s
[2021-03-25 10:43:34.943] [driver] [info] [Task Finished] Resolve in 0.011730s
[2021-03-25 10:43:34.956] [driver] [info] [Task Finished] Resolve in 0.013111s
[2021-03-25 10:43:34.956] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 1.90046s
[2021-03-25 10:43:34.956] [local ee] [info] slow path for Stage 0: total wall clock time: 1.89255s, time to process 1 row via slow path: 0.000274444ms
[2021-03-25 10:43:34.956] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.90048s

[2021-03-25 10:43:34.989] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:43:35.298] [driver] [info] [Task Finished] write to file in 0.309480s (1798491 rows, 273.80 MB)
[2021-03-25 10:43:35.298] [global] [info] writing output took 0.342324s
[2021-03-25 10:43:35.298] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.342422s
[2021-03-25 10:43:35.298] [global] [info] [Transform Stage] Stage 0 took 47.8124s
[2021-03-25 10:43:35.298] [global] [info] Query Execution took 47.8909s. (planning: 0.0784334s, execution: 47.8125s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.004999399185180664
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 48.16772723197937 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0218804,"llvm_optimization_time_s":0.332473,"llvm_compilation_time_s":0.151124,"total_compilation_time_s":0.501011,"sampling_time_s":0.109625,"stages":[{"stage_no":0,"fast_path_wall_time_s":45.0652,"fast_path_time_s":45.0685,"fast_path_per_row_time_ns":799.726,"slow_path_wall_time_s":1.89255,"slow_path_time_s":1.90046,"slow_path_per_row_time_ns":274.444}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.004999399185180664, "jobTime": 48.16772723197937, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
