[2021-03-25 10:43:35.755] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:43:35.756] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:43:35.756] [local ee] [info] initializing LLVM backend
[2021-03-25 10:43:35.756] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:43:35.756] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:43:35.757] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 10:43:35.757] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:43:35.757] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:43:35.757] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:43:35.891] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:43:35.896] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:43:35.912] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:43:35.920] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:43:35.946] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:43:35.966] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:43:35.979] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:43:36.010] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:43:36.016] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:43:36.031] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:43:36.033] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:43:36.034] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:43:36.035] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:43:36.036] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:43:36.037] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:43:36.038] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:43:36.039] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:43:36.041] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:43:36.041] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:43:36.057] [logical planner] [info] logical optimization took 0.021898ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:43:36.057] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:43:36.058] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:43:36.059] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:43:36.059] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:43:36.060] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:43:36.060] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:43:36.061] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:43:36.062] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:43:36.063] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:43:36.064] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:43:36.064] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:43:36.066] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:43:36.066] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:43:36.067] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:43:36.068] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:43:36.069] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:43:36.070] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:43:36.070] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:43:36.071] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:43:36.071] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:43:36.072] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:43:36.073] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:43:36.074] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:43:36.075] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:43:36.075] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:43:36.076] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:43:36.077] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:43:36.078] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:43:36.078] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:43:36.110] [global] [info] Stage0 depends on: 
[2021-03-25 10:43:36.457] [global] [info] Optimization via LLVM passes took 0.329862 ms
[2021-03-25 10:43:36.608] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:43:36.608] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.498276s
[2021-03-25 10:43:36.609] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:43:36.890] [driver] [info] [Task Finished] Transform to mem in 0.281471s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:43:37.170] [driver] [info] [Task Finished] Transform to mem in 0.279376s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:43:37.449] [driver] [info] [Task Finished] Transform to mem in 0.279406s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:43:37.729] [driver] [info] [Task Finished] Transform to mem in 0.279772s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:43:38.009] [driver] [info] [Task Finished] Transform to mem in 0.279776s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:43:38.289] [driver] [info] [Task Finished] Transform to mem in 0.280713s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:43:38.570] [driver] [info] [Task Finished] Transform to mem in 0.280461s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:43:38.849] [driver] [info] [Task Finished] Transform to mem in 0.279325s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:43:39.129] [driver] [info] [Task Finished] Transform to mem in 0.279392s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:43:39.408] [driver] [info] [Task Finished] Transform to mem in 0.279710s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:43:39.689] [driver] [info] [Task Finished] Transform to mem in 0.280317s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:43:39.968] [driver] [info] [Task Finished] Transform to mem in 0.279401s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:43:40.249] [driver] [info] [Task Finished] Transform to mem in 0.280413s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:43:40.527] [driver] [info] [Task Finished] Transform to mem in 0.278890s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:43:40.807] [driver] [info] [Task Finished] Transform to mem in 0.279201s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:43:41.085] [driver] [info] [Task Finished] Transform to mem in 0.278451s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:43:41.365] [driver] [info] [Task Finished] Transform to mem in 0.279479s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:43:41.646] [driver] [info] [Task Finished] Transform to mem in 0.281080s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:43:41.925] [driver] [info] [Task Finished] Transform to mem in 0.279555s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:43:42.204] [driver] [info] [Task Finished] Transform to mem in 0.278744s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:43:42.484] [driver] [info] [Task Finished] Transform to mem in 0.279559s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:43:42.762] [driver] [info] [Task Finished] Transform to mem in 0.278575s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:43:43.042] [driver] [info] [Task Finished] Transform to mem in 0.279303s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:43:43.320] [driver] [info] [Task Finished] Transform to mem in 0.278300s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:43:43.599] [driver] [info] [Task Finished] Transform to mem in 0.279330s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:43:43.878] [driver] [info] [Task Finished] Transform to mem in 0.278624s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:43:44.157] [driver] [info] [Task Finished] Transform to mem in 0.279394s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:43:44.436] [driver] [info] [Task Finished] Transform to mem in 0.278235s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:43:44.715] [driver] [info] [Task Finished] Transform to mem in 0.279618s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:43:44.994] [driver] [info] [Task Finished] Transform to mem in 0.278329s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:43:45.273] [driver] [info] [Task Finished] Transform to mem in 0.279513s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:43:45.552] [driver] [info] [Task Finished] Transform to mem in 0.278918s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:43:45.832] [driver] [info] [Task Finished] Transform to mem in 0.280327s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:43:46.112] [driver] [info] [Task Finished] Transform to mem in 0.279714s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:43:46.393] [driver] [info] [Task Finished] Transform to mem in 0.281171s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:43:46.672] [driver] [info] [Task Finished] Transform to mem in 0.278910s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:43:46.952] [driver] [info] [Task Finished] Transform to mem in 0.280160s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:43:47.232] [driver] [info] [Task Finished] Transform to mem in 0.279489s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:43:47.512] [driver] [info] [Task Finished] Transform to mem in 0.280333s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:43:47.791] [driver] [info] [Task Finished] Transform to mem in 0.279205s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:43:48.072] [driver] [info] [Task Finished] Transform to mem in 0.280218s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:43:48.351] [driver] [info] [Task Finished] Transform to mem in 0.279824s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:43:48.632] [driver] [info] [Task Finished] Transform to mem in 0.280701s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:43:48.912] [driver] [info] [Task Finished] Transform to mem in 0.279419s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:43:49.193] [driver] [info] [Task Finished] Transform to mem in 0.280833s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:43:49.472] [driver] [info] [Task Finished] Transform to mem in 0.279848s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:43:49.752] [driver] [info] [Task Finished] Transform to mem in 0.280042s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:43:50.032] [driver] [info] [Task Finished] Transform to mem in 0.279710s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:43:50.312] [driver] [info] [Task Finished] Transform to mem in 0.280061s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:43:50.592] [driver] [info] [Task Finished] Transform to mem in 0.279290s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:43:50.872] [driver] [info] [Task Finished] Transform to mem in 0.280024s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:43:51.151] [driver] [info] [Task Finished] Transform to mem in 0.279141s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:43:51.431] [driver] [info] [Task Finished] Transform to mem in 0.280062s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:43:51.710] [driver] [info] [Task Finished] Transform to mem in 0.279082s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:43:51.990] [driver] [info] [Task Finished] Transform to mem in 0.280110s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:43:52.269] [driver] [info] [Task Finished] Transform to mem in 0.278997s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:43:52.551] [driver] [info] [Task Finished] Transform to mem in 0.281667s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:43:52.831] [driver] [info] [Task Finished] Transform to mem in 0.279921s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:43:53.111] [driver] [info] [Task Finished] Transform to mem in 0.280053s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:43:53.391] [driver] [info] [Task Finished] Transform to mem in 0.280511s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:43:53.672] [driver] [info] [Task Finished] Transform to mem in 0.280321s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:43:53.951] [driver] [info] [Task Finished] Transform to mem in 0.279531s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:43:54.231] [driver] [info] [Task Finished] Transform to mem in 0.279576s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:43:54.509] [driver] [info] [Task Finished] Transform to mem in 0.278428s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:43:54.788] [driver] [info] [Task Finished] Transform to mem in 0.279124s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:43:55.067] [driver] [info] [Task Finished] Transform to mem in 0.278714s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:43:55.347] [driver] [info] [Task Finished] Transform to mem in 0.279471s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:43:55.626] [driver] [info] [Task Finished] Transform to mem in 0.279175s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:43:55.906] [driver] [info] [Task Finished] Transform to mem in 0.280156s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:43:56.185] [driver] [info] [Task Finished] Transform to mem in 0.278961s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:43:56.464] [driver] [info] [Task Finished] Transform to mem in 0.279141s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:43:56.743] [driver] [info] [Task Finished] Transform to mem in 0.278469s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:43:57.022] [driver] [info] [Task Finished] Transform to mem in 0.279519s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:43:57.302] [driver] [info] [Task Finished] Transform to mem in 0.279681s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:43:57.582] [driver] [info] [Task Finished] Transform to mem in 0.280523s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:43:57.862] [driver] [info] [Task Finished] Transform to mem in 0.279492s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:43:58.141] [driver] [info] [Task Finished] Transform to mem in 0.279525s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:43:58.421] [driver] [info] [Task Finished] Transform to mem in 0.279735s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:43:58.700] [driver] [info] [Task Finished] Transform to mem in 0.279121s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:43:58.979] [driver] [info] [Task Finished] Transform to mem in 0.278718s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:43:59.258] [driver] [info] [Task Finished] Transform to mem in 0.278698s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:43:59.538] [driver] [info] [Task Finished] Transform to mem in 0.279928s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:43:59.818] [driver] [info] [Task Finished] Transform to mem in 0.280651s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:44:00.097] [driver] [info] [Task Finished] Transform to mem in 0.279069s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:44:00.377] [driver] [info] [Task Finished] Transform to mem in 0.279208s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:44:00.655] [driver] [info] [Task Finished] Transform to mem in 0.278707s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:44:00.934] [driver] [info] [Task Finished] Transform to mem in 0.278279s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:44:01.213] [driver] [info] [Task Finished] Transform to mem in 0.279198s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:44:01.492] [driver] [info] [Task Finished] Transform to mem in 0.278895s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:44:01.772] [driver] [info] [Task Finished] Transform to mem in 0.279891s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:44:02.051] [driver] [info] [Task Finished] Transform to mem in 0.279236s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:44:02.330] [driver] [info] [Task Finished] Transform to mem in 0.279121s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:44:02.610] [driver] [info] [Task Finished] Transform to mem in 0.279517s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:44:02.895] [driver] [info] [Task Finished] Transform to mem in 0.285266s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:44:03.174] [driver] [info] [Task Finished] Transform to mem in 0.278666s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:44:03.453] [driver] [info] [Task Finished] Transform to mem in 0.279040s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:44:03.731] [driver] [info] [Task Finished] Transform to mem in 0.278472s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:44:04.011] [driver] [info] [Task Finished] Transform to mem in 0.279755s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:44:04.290] [driver] [info] [Task Finished] Transform to mem in 0.279462s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:44:04.570] [driver] [info] [Task Finished] Transform to mem in 0.279554s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:44:04.850] [driver] [info] [Task Finished] Transform to mem in 0.280411s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:44:05.130] [driver] [info] [Task Finished] Transform to mem in 0.279656s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:44:05.409] [driver] [info] [Task Finished] Transform to mem in 0.278986s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:44:05.688] [driver] [info] [Task Finished] Transform to mem in 0.279332s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:44:05.967] [driver] [info] [Task Finished] Transform to mem in 0.278684s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:44:06.247] [driver] [info] [Task Finished] Transform to mem in 0.279906s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:44:06.527] [driver] [info] [Task Finished] Transform to mem in 0.279534s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:44:06.806] [driver] [info] [Task Finished] Transform to mem in 0.279566s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:44:07.086] [driver] [info] [Task Finished] Transform to mem in 0.280106s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:44:07.366] [driver] [info] [Task Finished] Transform to mem in 0.280076s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:44:07.646] [driver] [info] [Task Finished] Transform to mem in 0.279454s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:44:07.926] [driver] [info] [Task Finished] Transform to mem in 0.280320s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:44:08.207] [driver] [info] [Task Finished] Transform to mem in 0.280853s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:44:08.488] [driver] [info] [Task Finished] Transform to mem in 0.280977s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:44:08.768] [driver] [info] [Task Finished] Transform to mem in 0.280059s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:44:09.049] [driver] [info] [Task Finished] Transform to mem in 0.280320s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:44:09.330] [driver] [info] [Task Finished] Transform to mem in 0.281060s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:44:09.610] [driver] [info] [Task Finished] Transform to mem in 0.280451s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:44:09.891] [driver] [info] [Task Finished] Transform to mem in 0.280993s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:44:10.172] [driver] [info] [Task Finished] Transform to mem in 0.280798s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:44:10.452] [driver] [info] [Task Finished] Transform to mem in 0.280009s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:44:10.733] [driver] [info] [Task Finished] Transform to mem in 0.280884s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:44:11.014] [driver] [info] [Task Finished] Transform to mem in 0.281233s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:44:11.295] [driver] [info] [Task Finished] Transform to mem in 0.280830s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:44:11.576] [driver] [info] [Task Finished] Transform to mem in 0.280704s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:44:11.856] [driver] [info] [Task Finished] Transform to mem in 0.279967s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:44:12.136] [driver] [info] [Task Finished] Transform to mem in 0.280043s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:44:12.416] [driver] [info] [Task Finished] Transform to mem in 0.280100s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:44:12.696] [driver] [info] [Task Finished] Transform to mem in 0.280372s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:44:12.976] [driver] [info] [Task Finished] Transform to mem in 0.279924s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:44:13.257] [driver] [info] [Task Finished] Transform to mem in 0.280465s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:44:13.537] [driver] [info] [Task Finished] Transform to mem in 0.280344s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:44:13.818] [driver] [info] [Task Finished] Transform to mem in 0.280927s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:44:14.098] [driver] [info] [Task Finished] Transform to mem in 0.280342s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:44:14.378] [driver] [info] [Task Finished] Transform to mem in 0.279875s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:44:14.658] [driver] [info] [Task Finished] Transform to mem in 0.280248s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:44:14.939] [driver] [info] [Task Finished] Transform to mem in 0.280708s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:44:15.219] [driver] [info] [Task Finished] Transform to mem in 0.280146s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:44:15.500] [driver] [info] [Task Finished] Transform to mem in 0.280964s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:44:15.780] [driver] [info] [Task Finished] Transform to mem in 0.279885s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:44:16.061] [driver] [info] [Task Finished] Transform to mem in 0.280732s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:44:16.341] [driver] [info] [Task Finished] Transform to mem in 0.280187s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:44:16.621] [driver] [info] [Task Finished] Transform to mem in 0.279544s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:44:16.901] [driver] [info] [Task Finished] Transform to mem in 0.280004s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:44:17.181] [driver] [info] [Task Finished] Transform to mem in 0.279832s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:44:17.461] [driver] [info] [Task Finished] Transform to mem in 0.280309s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:44:17.742] [driver] [info] [Task Finished] Transform to mem in 0.280706s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:44:18.023] [driver] [info] [Task Finished] Transform to mem in 0.281190s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:44:18.303] [driver] [info] [Task Finished] Transform to mem in 0.280154s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:44:18.584] [driver] [info] [Task Finished] Transform to mem in 0.280456s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:44:18.864] [driver] [info] [Task Finished] Transform to mem in 0.280306s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:44:19.144] [driver] [info] [Task Finished] Transform to mem in 0.280244s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:44:19.425] [driver] [info] [Task Finished] Transform to mem in 0.280615s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:44:19.705] [driver] [info] [Task Finished] Transform to mem in 0.280110s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:44:19.986] [driver] [info] [Task Finished] Transform to mem in 0.280877s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:44:20.266] [driver] [info] [Task Finished] Transform to mem in 0.279761s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:44:20.546] [driver] [info] [Task Finished] Transform to mem in 0.280261s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:44:20.826] [driver] [info] [Task Finished] Transform to mem in 0.279930s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:44:21.105] [driver] [info] [Task Finished] Transform to mem in 0.279570s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:44:21.419] [driver] [info] [Task Finished] Transform to mem in 0.313956s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:44:21.419] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.8109s
[2021-03-25 10:44:21.419] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.8077s, 56350770 input rows, time to process 1 row via fast path: 0.000795157ms
[2021-03-25 10:44:21.420] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:44:21.424] [local ee] [info] compiled pure python pipeline in 0.004156s
[2021-03-25 10:44:21.424] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:44:21.425] [local ee] [info] Created 160 resolve tasks in 0.001173s
[2021-03-25 10:44:21.425] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:44:21.437] [driver] [info] [Task Finished] Resolve in 0.012089s
[2021-03-25 10:44:21.449] [driver] [info] [Task Finished] Resolve in 0.012156s
[2021-03-25 10:44:21.461] [driver] [info] [Task Finished] Resolve in 0.011801s
[2021-03-25 10:44:21.473] [driver] [info] [Task Finished] Resolve in 0.011828s
[2021-03-25 10:44:21.485] [driver] [info] [Task Finished] Resolve in 0.011843s
[2021-03-25 10:44:21.497] [driver] [info] [Task Finished] Resolve in 0.011898s
[2021-03-25 10:44:21.509] [driver] [info] [Task Finished] Resolve in 0.012123s
[2021-03-25 10:44:21.520] [driver] [info] [Task Finished] Resolve in 0.011737s
[2021-03-25 10:44:21.532] [driver] [info] [Task Finished] Resolve in 0.011895s
[2021-03-25 10:44:21.544] [driver] [info] [Task Finished] Resolve in 0.011975s
[2021-03-25 10:44:21.556] [driver] [info] [Task Finished] Resolve in 0.011779s
[2021-03-25 10:44:21.568] [driver] [info] [Task Finished] Resolve in 0.012014s
[2021-03-25 10:44:21.580] [driver] [info] [Task Finished] Resolve in 0.011897s
[2021-03-25 10:44:21.592] [driver] [info] [Task Finished] Resolve in 0.011811s
[2021-03-25 10:44:21.604] [driver] [info] [Task Finished] Resolve in 0.011879s
[2021-03-25 10:44:21.616] [driver] [info] [Task Finished] Resolve in 0.011764s
[2021-03-25 10:44:21.628] [driver] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:44:21.640] [driver] [info] [Task Finished] Resolve in 0.012102s
[2021-03-25 10:44:21.652] [driver] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:44:21.663] [driver] [info] [Task Finished] Resolve in 0.011845s
[2021-03-25 10:44:21.675] [driver] [info] [Task Finished] Resolve in 0.011893s
[2021-03-25 10:44:21.687] [driver] [info] [Task Finished] Resolve in 0.011815s
[2021-03-25 10:44:21.699] [driver] [info] [Task Finished] Resolve in 0.012077s
[2021-03-25 10:44:21.711] [driver] [info] [Task Finished] Resolve in 0.011775s
[2021-03-25 10:44:21.723] [driver] [info] [Task Finished] Resolve in 0.011857s
[2021-03-25 10:44:21.735] [driver] [info] [Task Finished] Resolve in 0.012001s
[2021-03-25 10:44:21.747] [driver] [info] [Task Finished] Resolve in 0.011820s
[2021-03-25 10:44:21.759] [driver] [info] [Task Finished] Resolve in 0.012052s
[2021-03-25 10:44:21.771] [driver] [info] [Task Finished] Resolve in 0.011854s
[2021-03-25 10:44:21.782] [driver] [info] [Task Finished] Resolve in 0.011808s
[2021-03-25 10:44:21.794] [driver] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:44:21.806] [driver] [info] [Task Finished] Resolve in 0.011752s
[2021-03-25 10:44:21.818] [driver] [info] [Task Finished] Resolve in 0.011922s
[2021-03-25 10:44:21.830] [driver] [info] [Task Finished] Resolve in 0.012087s
[2021-03-25 10:44:21.842] [driver] [info] [Task Finished] Resolve in 0.011745s
[2021-03-25 10:44:21.854] [driver] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:44:21.866] [driver] [info] [Task Finished] Resolve in 0.011797s
[2021-03-25 10:44:21.877] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:44:21.889] [driver] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:44:21.901] [driver] [info] [Task Finished] Resolve in 0.011773s
[2021-03-25 10:44:21.913] [driver] [info] [Task Finished] Resolve in 0.011781s
[2021-03-25 10:44:21.925] [driver] [info] [Task Finished] Resolve in 0.012041s
[2021-03-25 10:44:21.937] [driver] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:44:21.949] [driver] [info] [Task Finished] Resolve in 0.012027s
[2021-03-25 10:44:21.961] [driver] [info] [Task Finished] Resolve in 0.011841s
[2021-03-25 10:44:21.972] [driver] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:44:21.984] [driver] [info] [Task Finished] Resolve in 0.011833s
[2021-03-25 10:44:21.996] [driver] [info] [Task Finished] Resolve in 0.011753s
[2021-03-25 10:44:22.008] [driver] [info] [Task Finished] Resolve in 0.011900s
[2021-03-25 10:44:22.020] [driver] [info] [Task Finished] Resolve in 0.012283s
[2021-03-25 10:44:22.032] [driver] [info] [Task Finished] Resolve in 0.011805s
[2021-03-25 10:44:22.044] [driver] [info] [Task Finished] Resolve in 0.011865s
[2021-03-25 10:44:22.056] [driver] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:44:22.068] [driver] [info] [Task Finished] Resolve in 0.011913s
[2021-03-25 10:44:22.080] [driver] [info] [Task Finished] Resolve in 0.011942s
[2021-03-25 10:44:22.092] [driver] [info] [Task Finished] Resolve in 0.011772s
[2021-03-25 10:44:22.103] [driver] [info] [Task Finished] Resolve in 0.011767s
[2021-03-25 10:44:22.115] [driver] [info] [Task Finished] Resolve in 0.012035s
[2021-03-25 10:44:22.127] [driver] [info] [Task Finished] Resolve in 0.011785s
[2021-03-25 10:44:22.139] [driver] [info] [Task Finished] Resolve in 0.012020s
[2021-03-25 10:44:22.151] [driver] [info] [Task Finished] Resolve in 0.011862s
[2021-03-25 10:44:22.163] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:44:22.175] [driver] [info] [Task Finished] Resolve in 0.011840s
[2021-03-25 10:44:22.187] [driver] [info] [Task Finished] Resolve in 0.011777s
[2021-03-25 10:44:22.198] [driver] [info] [Task Finished] Resolve in 0.011936s
[2021-03-25 10:44:22.211] [driver] [info] [Task Finished] Resolve in 0.012053s
[2021-03-25 10:44:22.222] [driver] [info] [Task Finished] Resolve in 0.011804s
[2021-03-25 10:44:22.234] [driver] [info] [Task Finished] Resolve in 0.011834s
[2021-03-25 10:44:22.246] [driver] [info] [Task Finished] Resolve in 0.011852s
[2021-03-25 10:44:22.258] [driver] [info] [Task Finished] Resolve in 0.011937s
[2021-03-25 10:44:22.270] [driver] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:44:22.282] [driver] [info] [Task Finished] Resolve in 0.011779s
[2021-03-25 10:44:22.293] [driver] [info] [Task Finished] Resolve in 0.011751s
[2021-03-25 10:44:22.306] [driver] [info] [Task Finished] Resolve in 0.012058s
[2021-03-25 10:44:22.317] [driver] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:44:22.329] [driver] [info] [Task Finished] Resolve in 0.011964s
[2021-03-25 10:44:22.341] [driver] [info] [Task Finished] Resolve in 0.011875s
[2021-03-25 10:44:22.353] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:44:22.365] [driver] [info] [Task Finished] Resolve in 0.011846s
[2021-03-25 10:44:22.377] [driver] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:44:22.389] [driver] [info] [Task Finished] Resolve in 0.011967s
[2021-03-25 10:44:22.401] [driver] [info] [Task Finished] Resolve in 0.012044s
[2021-03-25 10:44:22.413] [driver] [info] [Task Finished] Resolve in 0.011786s
[2021-03-25 10:44:22.424] [driver] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:44:22.436] [driver] [info] [Task Finished] Resolve in 0.011879s
[2021-03-25 10:44:22.448] [driver] [info] [Task Finished] Resolve in 0.011949s
[2021-03-25 10:44:22.460] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:44:22.472] [driver] [info] [Task Finished] Resolve in 0.011805s
[2021-03-25 10:44:22.484] [driver] [info] [Task Finished] Resolve in 0.011758s
[2021-03-25 10:44:22.496] [driver] [info] [Task Finished] Resolve in 0.012049s
[2021-03-25 10:44:22.508] [driver] [info] [Task Finished] Resolve in 0.011975s
[2021-03-25 10:44:22.520] [driver] [info] [Task Finished] Resolve in 0.011887s
[2021-03-25 10:44:22.532] [driver] [info] [Task Finished] Resolve in 0.011909s
[2021-03-25 10:44:22.543] [driver] [info] [Task Finished] Resolve in 0.011880s
[2021-03-25 10:44:22.555] [driver] [info] [Task Finished] Resolve in 0.011776s
[2021-03-25 10:44:22.567] [driver] [info] [Task Finished] Resolve in 0.011890s
[2021-03-25 10:44:22.579] [driver] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:44:22.591] [driver] [info] [Task Finished] Resolve in 0.012062s
[2021-03-25 10:44:22.603] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:44:22.615] [driver] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:44:22.627] [driver] [info] [Task Finished] Resolve in 0.011916s
[2021-03-25 10:44:22.639] [driver] [info] [Task Finished] Resolve in 0.012042s
[2021-03-25 10:44:22.651] [driver] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:44:22.663] [driver] [info] [Task Finished] Resolve in 0.011871s
[2021-03-25 10:44:22.674] [driver] [info] [Task Finished] Resolve in 0.011742s
[2021-03-25 10:44:22.686] [driver] [info] [Task Finished] Resolve in 0.012038s
[2021-03-25 10:44:22.698] [driver] [info] [Task Finished] Resolve in 0.011986s
[2021-03-25 10:44:22.710] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:44:22.722] [driver] [info] [Task Finished] Resolve in 0.011907s
[2021-03-25 10:44:22.734] [driver] [info] [Task Finished] Resolve in 0.011803s
[2021-03-25 10:44:22.746] [driver] [info] [Task Finished] Resolve in 0.011761s
[2021-03-25 10:44:22.758] [driver] [info] [Task Finished] Resolve in 0.011951s
[2021-03-25 10:44:22.769] [driver] [info] [Task Finished] Resolve in 0.011857s
[2021-03-25 10:44:22.782] [driver] [info] [Task Finished] Resolve in 0.012054s
[2021-03-25 10:44:22.793] [driver] [info] [Task Finished] Resolve in 0.011804s
[2021-03-25 10:44:22.805] [driver] [info] [Task Finished] Resolve in 0.011793s
[2021-03-25 10:44:22.817] [driver] [info] [Task Finished] Resolve in 0.011887s
[2021-03-25 10:44:22.829] [driver] [info] [Task Finished] Resolve in 0.011968s
[2021-03-25 10:44:22.841] [driver] [info] [Task Finished] Resolve in 0.011747s
[2021-03-25 10:44:22.853] [driver] [info] [Task Finished] Resolve in 0.011862s
[2021-03-25 10:44:22.864] [driver] [info] [Task Finished] Resolve in 0.011711s
[2021-03-25 10:44:22.876] [driver] [info] [Task Finished] Resolve in 0.012038s
[2021-03-25 10:44:22.888] [driver] [info] [Task Finished] Resolve in 0.012005s
[2021-03-25 10:44:22.900] [driver] [info] [Task Finished] Resolve in 0.011791s
[2021-03-25 10:44:22.912] [driver] [info] [Task Finished] Resolve in 0.011870s
[2021-03-25 10:44:22.924] [driver] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:44:22.936] [driver] [info] [Task Finished] Resolve in 0.011790s
[2021-03-25 10:44:22.948] [driver] [info] [Task Finished] Resolve in 0.011982s
[2021-03-25 10:44:22.960] [driver] [info] [Task Finished] Resolve in 0.011797s
[2021-03-25 10:44:22.972] [driver] [info] [Task Finished] Resolve in 0.012017s
[2021-03-25 10:44:22.983] [driver] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:44:22.995] [driver] [info] [Task Finished] Resolve in 0.011783s
[2021-03-25 10:44:23.007] [driver] [info] [Task Finished] Resolve in 0.011874s
[2021-03-25 10:44:23.019] [driver] [info] [Task Finished] Resolve in 0.012007s
[2021-03-25 10:44:23.031] [driver] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:44:23.043] [driver] [info] [Task Finished] Resolve in 0.011859s
[2021-03-25 10:44:23.055] [driver] [info] [Task Finished] Resolve in 0.011728s
[2021-03-25 10:44:23.067] [driver] [info] [Task Finished] Resolve in 0.012002s
[2021-03-25 10:44:23.079] [driver] [info] [Task Finished] Resolve in 0.012012s
[2021-03-25 10:44:23.090] [driver] [info] [Task Finished] Resolve in 0.011787s
[2021-03-25 10:44:23.102] [driver] [info] [Task Finished] Resolve in 0.011882s
[2021-03-25 10:44:23.114] [driver] [info] [Task Finished] Resolve in 0.011845s
[2021-03-25 10:44:23.126] [driver] [info] [Task Finished] Resolve in 0.011719s
[2021-03-25 10:44:23.138] [driver] [info] [Task Finished] Resolve in 0.011916s
[2021-03-25 10:44:23.150] [driver] [info] [Task Finished] Resolve in 0.011821s
[2021-03-25 10:44:23.162] [driver] [info] [Task Finished] Resolve in 0.011945s
[2021-03-25 10:44:23.173] [driver] [info] [Task Finished] Resolve in 0.011830s
[2021-03-25 10:44:23.185] [driver] [info] [Task Finished] Resolve in 0.011820s
[2021-03-25 10:44:23.197] [driver] [info] [Task Finished] Resolve in 0.011839s
[2021-03-25 10:44:23.209] [driver] [info] [Task Finished] Resolve in 0.012006s
[2021-03-25 10:44:23.221] [driver] [info] [Task Finished] Resolve in 0.011763s
[2021-03-25 10:44:23.233] [driver] [info] [Task Finished] Resolve in 0.011855s
[2021-03-25 10:44:23.245] [driver] [info] [Task Finished] Resolve in 0.011718s
[2021-03-25 10:44:23.257] [driver] [info] [Task Finished] Resolve in 0.011935s
[2021-03-25 10:44:23.269] [driver] [info] [Task Finished] Resolve in 0.012109s
[2021-03-25 10:44:23.280] [driver] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:44:23.292] [driver] [info] [Task Finished] Resolve in 0.011840s
[2021-03-25 10:44:23.304] [driver] [info] [Task Finished] Resolve in 0.011799s
[2021-03-25 10:44:23.316] [driver] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:44:23.329] [driver] [info] [Task Finished] Resolve in 0.013371s
[2021-03-25 10:44:23.329] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 1.91s
[2021-03-25 10:44:23.329] [local ee] [info] slow path for Stage 0: total wall clock time: 1.90232s, time to process 1 row via slow path: 0.000275861ms
[2021-03-25 10:44:23.329] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 1.91002s

[2021-03-25 10:44:23.362] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:44:23.670] [driver] [info] [Task Finished] write to file in 0.307392s (1798491 rows, 273.80 MB)
[2021-03-25 10:44:23.670] [global] [info] writing output took 0.340427s
[2021-03-25 10:44:23.670] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.34051s
[2021-03-25 10:44:23.670] [global] [info] [Transform Stage] Stage 0 took 47.5598s
[2021-03-25 10:44:23.670] [global] [info] Query Execution took 47.6381s. (planning: 0.0782499s, execution: 47.5598s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005044698715209961
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 47.91431760787964 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0218978,"llvm_optimization_time_s":0.329862,"llvm_compilation_time_s":0.151039,"total_compilation_time_s":0.498274,"sampling_time_s":0.109552,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.8077,"fast_path_time_s":44.811,"fast_path_per_row_time_ns":795.157,"slow_path_wall_time_s":1.90232,"slow_path_time_s":1.91,"slow_path_per_row_time_ns":275.861}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.005044698715209961, "jobTime": 47.91431760787964, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
