[2021-03-25 11:26:25.597] [global] [error] could not find backend, defaulting to local
[2021-03-25 11:26:25.597] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 11:26:25.597] [local ee] [info] initializing LLVM backend
[2021-03-25 11:26:25.597] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 11:26:25.597] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 11:26:25.598] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 11:26:25.598] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 11:26:25.598] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 11:26:25.599] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 11:26:25.732] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:26:25.738] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:26:25.753] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:26:25.762] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:26:25.788] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:26:25.807] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:26:25.821] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:26:25.852] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:26:25.858] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:26:25.873] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:26:25.875] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:26:25.876] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:26:25.876] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:26:25.878] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:26:25.879] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:26:25.880] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:26:25.881] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:26:25.882] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:26:25.883] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:26:25.899] [logical planner] [info] logical optimization took 0.021987ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 11:26:25.899] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:26:25.899] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:26:25.900] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 11:26:25.901] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 11:26:25.901] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 11:26:25.902] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 11:26:25.903] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 11:26:25.904] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 11:26:25.904] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 11:26:25.905] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 11:26:25.906] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:26:25.907] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:26:25.908] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:26:25.908] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:26:25.910] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:26:25.911] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:26:25.911] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 11:26:25.912] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 11:26:25.913] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 11:26:25.913] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 11:26:25.914] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 11:26:25.915] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 11:26:25.915] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 11:26:25.916] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 11:26:25.917] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:26:25.918] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:26:25.919] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:26:25.920] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:26:25.920] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:26:25.952] [global] [info] Stage0 depends on: 
[2021-03-25 11:26:26.299] [global] [info] Optimization via LLVM passes took 0.329777 ms
[2021-03-25 11:26:26.450] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 11:26:26.450] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.498215s
[2021-03-25 11:26:26.450] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 11:26:26.732] [driver] [info] [Task Finished] Transform to mem in 0.281192s (11105 normal rows, 43095 exceptions)
[2021-03-25 11:26:27.011] [driver] [info] [Task Finished] Transform to mem in 0.279293s (11073 normal rows, 43414 exceptions)
[2021-03-25 11:26:27.290] [driver] [info] [Task Finished] Transform to mem in 0.279215s (11153 normal rows, 42970 exceptions)
[2021-03-25 11:26:27.570] [driver] [info] [Task Finished] Transform to mem in 0.279432s (11047 normal rows, 43210 exceptions)
[2021-03-25 11:26:27.849] [driver] [info] [Task Finished] Transform to mem in 0.279005s (10987 normal rows, 43113 exceptions)
[2021-03-25 11:26:28.127] [driver] [info] [Task Finished] Transform to mem in 0.278313s (10997 normal rows, 42873 exceptions)
[2021-03-25 11:26:28.406] [driver] [info] [Task Finished] Transform to mem in 0.279196s (11036 normal rows, 43142 exceptions)
[2021-03-25 11:26:28.685] [driver] [info] [Task Finished] Transform to mem in 0.278474s (11005 normal rows, 42741 exceptions)
[2021-03-25 11:26:28.963] [driver] [info] [Task Finished] Transform to mem in 0.278338s (11086 normal rows, 43015 exceptions)
[2021-03-25 11:26:29.242] [driver] [info] [Task Finished] Transform to mem in 0.279302s (11092 normal rows, 43495 exceptions)
[2021-03-25 11:26:29.521] [driver] [info] [Task Finished] Transform to mem in 0.278952s (11153 normal rows, 42968 exceptions)
[2021-03-25 11:26:29.800] [driver] [info] [Task Finished] Transform to mem in 0.278321s (11026 normal rows, 43206 exceptions)
[2021-03-25 11:26:30.078] [driver] [info] [Task Finished] Transform to mem in 0.278226s (11008 normal rows, 43077 exceptions)
[2021-03-25 11:26:30.356] [driver] [info] [Task Finished] Transform to mem in 0.277964s (10997 normal rows, 42910 exceptions)
[2021-03-25 11:26:30.634] [driver] [info] [Task Finished] Transform to mem in 0.277935s (11036 normal rows, 43139 exceptions)
[2021-03-25 11:26:30.912] [driver] [info] [Task Finished] Transform to mem in 0.277959s (11005 normal rows, 42744 exceptions)
[2021-03-25 11:26:31.190] [driver] [info] [Task Finished] Transform to mem in 0.277774s (11086 normal rows, 42996 exceptions)
[2021-03-25 11:26:31.469] [driver] [info] [Task Finished] Transform to mem in 0.279036s (11092 normal rows, 43505 exceptions)
[2021-03-25 11:26:31.747] [driver] [info] [Task Finished] Transform to mem in 0.278488s (11153 normal rows, 42978 exceptions)
[2021-03-25 11:26:32.025] [driver] [info] [Task Finished] Transform to mem in 0.277802s (11026 normal rows, 43205 exceptions)
[2021-03-25 11:26:32.303] [driver] [info] [Task Finished] Transform to mem in 0.278433s (10982 normal rows, 43059 exceptions)
[2021-03-25 11:26:32.582] [driver] [info] [Task Finished] Transform to mem in 0.278421s (11023 normal rows, 42910 exceptions)
[2021-03-25 11:26:32.860] [driver] [info] [Task Finished] Transform to mem in 0.278309s (11036 normal rows, 43115 exceptions)
[2021-03-25 11:26:33.138] [driver] [info] [Task Finished] Transform to mem in 0.277683s (11005 normal rows, 42772 exceptions)
[2021-03-25 11:26:33.416] [driver] [info] [Task Finished] Transform to mem in 0.278154s (11086 normal rows, 42970 exceptions)
[2021-03-25 11:26:33.694] [driver] [info] [Task Finished] Transform to mem in 0.278314s (11079 normal rows, 43539 exceptions)
[2021-03-25 11:26:33.973] [driver] [info] [Task Finished] Transform to mem in 0.278561s (11111 normal rows, 42961 exceptions)
[2021-03-25 11:26:34.251] [driver] [info] [Task Finished] Transform to mem in 0.278410s (11076 normal rows, 43220 exceptions)
[2021-03-25 11:26:34.530] [driver] [info] [Task Finished] Transform to mem in 0.278343s (10987 normal rows, 43068 exceptions)
[2021-03-25 11:26:34.808] [driver] [info] [Task Finished] Transform to mem in 0.277707s (11023 normal rows, 42880 exceptions)
[2021-03-25 11:26:35.087] [driver] [info] [Task Finished] Transform to mem in 0.279012s (11036 normal rows, 43053 exceptions)
[2021-03-25 11:26:35.364] [driver] [info] [Task Finished] Transform to mem in 0.277556s (10992 normal rows, 42864 exceptions)
[2021-03-25 11:26:35.642] [driver] [info] [Task Finished] Transform to mem in 0.277929s (11099 normal rows, 42882 exceptions)
[2021-03-25 11:26:35.920] [driver] [info] [Task Finished] Transform to mem in 0.278229s (11063 normal rows, 43617 exceptions)
[2021-03-25 11:26:36.198] [driver] [info] [Task Finished] Transform to mem in 0.278119s (11127 normal rows, 42969 exceptions)
[2021-03-25 11:26:36.477] [driver] [info] [Task Finished] Transform to mem in 0.277995s (11076 normal rows, 43221 exceptions)
[2021-03-25 11:26:36.755] [driver] [info] [Task Finished] Transform to mem in 0.278141s (10987 normal rows, 43063 exceptions)
[2021-03-25 11:26:37.034] [driver] [info] [Task Finished] Transform to mem in 0.279110s (11004 normal rows, 42876 exceptions)
[2021-03-25 11:26:37.314] [driver] [info] [Task Finished] Transform to mem in 0.280158s (11026 normal rows, 43041 exceptions)
[2021-03-25 11:26:37.592] [driver] [info] [Task Finished] Transform to mem in 0.277952s (11021 normal rows, 42887 exceptions)
[2021-03-25 11:26:37.870] [driver] [info] [Task Finished] Transform to mem in 0.277843s (11064 normal rows, 42832 exceptions)
[2021-03-25 11:26:38.151] [driver] [info] [Task Finished] Transform to mem in 0.280918s (11098 normal rows, 43603 exceptions)
[2021-03-25 11:26:38.429] [driver] [info] [Task Finished] Transform to mem in 0.278549s (11127 normal rows, 43028 exceptions)
[2021-03-25 11:26:38.707] [driver] [info] [Task Finished] Transform to mem in 0.277759s (11076 normal rows, 43212 exceptions)
[2021-03-25 11:26:38.986] [driver] [info] [Task Finished] Transform to mem in 0.278645s (10987 normal rows, 43041 exceptions)
[2021-03-25 11:26:39.265] [driver] [info] [Task Finished] Transform to mem in 0.278971s (11004 normal rows, 42913 exceptions)
[2021-03-25 11:26:39.543] [driver] [info] [Task Finished] Transform to mem in 0.278339s (11026 normal rows, 43037 exceptions)
[2021-03-25 11:26:39.822] [driver] [info] [Task Finished] Transform to mem in 0.278586s (11012 normal rows, 42883 exceptions)
[2021-03-25 11:26:40.100] [driver] [info] [Task Finished] Transform to mem in 0.278376s (11073 normal rows, 42820 exceptions)
[2021-03-25 11:26:40.379] [driver] [info] [Task Finished] Transform to mem in 0.278719s (11095 normal rows, 43503 exceptions)
[2021-03-25 11:26:40.657] [driver] [info] [Task Finished] Transform to mem in 0.277916s (11130 normal rows, 43084 exceptions)
[2021-03-25 11:26:40.935] [driver] [info] [Task Finished] Transform to mem in 0.278308s (11076 normal rows, 43152 exceptions)
[2021-03-25 11:26:41.214] [driver] [info] [Task Finished] Transform to mem in 0.278671s (10976 normal rows, 43110 exceptions)
[2021-03-25 11:26:41.492] [driver] [info] [Task Finished] Transform to mem in 0.278534s (11015 normal rows, 42966 exceptions)
[2021-03-25 11:26:41.770] [driver] [info] [Task Finished] Transform to mem in 0.278008s (11026 normal rows, 43035 exceptions)
[2021-03-25 11:26:42.048] [driver] [info] [Task Finished] Transform to mem in 0.277881s (11012 normal rows, 42888 exceptions)
[2021-03-25 11:26:42.326] [driver] [info] [Task Finished] Transform to mem in 0.277556s (11073 normal rows, 42754 exceptions)
[2021-03-25 11:26:42.605] [driver] [info] [Task Finished] Transform to mem in 0.279188s (11095 normal rows, 43552 exceptions)
[2021-03-25 11:26:42.884] [driver] [info] [Task Finished] Transform to mem in 0.278679s (11130 normal rows, 43033 exceptions)
[2021-03-25 11:26:43.163] [driver] [info] [Task Finished] Transform to mem in 0.278843s (11069 normal rows, 43142 exceptions)
[2021-03-25 11:26:43.441] [driver] [info] [Task Finished] Transform to mem in 0.278817s (10974 normal rows, 43172 exceptions)
[2021-03-25 11:26:43.720] [driver] [info] [Task Finished] Transform to mem in 0.278735s (11008 normal rows, 42964 exceptions)
[2021-03-25 11:26:43.998] [driver] [info] [Task Finished] Transform to mem in 0.278105s (11042 normal rows, 43023 exceptions)
[2021-03-25 11:26:44.276] [driver] [info] [Task Finished] Transform to mem in 0.277879s (11012 normal rows, 42911 exceptions)
[2021-03-25 11:26:44.554] [driver] [info] [Task Finished] Transform to mem in 0.277939s (11063 normal rows, 42726 exceptions)
[2021-03-25 11:26:44.833] [driver] [info] [Task Finished] Transform to mem in 0.278713s (11105 normal rows, 43555 exceptions)
[2021-03-25 11:26:45.112] [driver] [info] [Task Finished] Transform to mem in 0.278937s (11081 normal rows, 43050 exceptions)
[2021-03-25 11:26:45.391] [driver] [info] [Task Finished] Transform to mem in 0.278852s (11087 normal rows, 43150 exceptions)
[2021-03-25 11:26:45.669] [driver] [info] [Task Finished] Transform to mem in 0.278219s (11005 normal rows, 43164 exceptions)
[2021-03-25 11:26:45.948] [driver] [info] [Task Finished] Transform to mem in 0.278647s (11008 normal rows, 42975 exceptions)
[2021-03-25 11:26:46.226] [driver] [info] [Task Finished] Transform to mem in 0.278424s (11042 normal rows, 42959 exceptions)
[2021-03-25 11:26:46.505] [driver] [info] [Task Finished] Transform to mem in 0.278613s (11002 normal rows, 42964 exceptions)
[2021-03-25 11:26:46.782] [driver] [info] [Task Finished] Transform to mem in 0.277734s (11073 normal rows, 42720 exceptions)
[2021-03-25 11:26:47.062] [driver] [info] [Task Finished] Transform to mem in 0.279208s (11088 normal rows, 43511 exceptions)
[2021-03-25 11:26:47.340] [driver] [info] [Task Finished] Transform to mem in 0.278807s (11098 normal rows, 43112 exceptions)
[2021-03-25 11:26:47.619] [driver] [info] [Task Finished] Transform to mem in 0.278918s (11087 normal rows, 43044 exceptions)
[2021-03-25 11:26:47.898] [driver] [info] [Task Finished] Transform to mem in 0.278307s (11005 normal rows, 43229 exceptions)
[2021-03-25 11:26:48.176] [driver] [info] [Task Finished] Transform to mem in 0.278385s (11008 normal rows, 43017 exceptions)
[2021-03-25 11:26:48.455] [driver] [info] [Task Finished] Transform to mem in 0.278399s (11024 normal rows, 42947 exceptions)
[2021-03-25 11:26:48.733] [driver] [info] [Task Finished] Transform to mem in 0.278899s (11020 normal rows, 42976 exceptions)
[2021-03-25 11:26:49.011] [driver] [info] [Task Finished] Transform to mem in 0.277622s (11036 normal rows, 42710 exceptions)
[2021-03-25 11:26:49.290] [driver] [info] [Task Finished] Transform to mem in 0.279156s (11125 normal rows, 43517 exceptions)
[2021-03-25 11:26:49.569] [driver] [info] [Task Finished] Transform to mem in 0.278590s (11098 normal rows, 43115 exceptions)
[2021-03-25 11:26:49.847] [driver] [info] [Task Finished] Transform to mem in 0.278118s (11087 normal rows, 42938 exceptions)
[2021-03-25 11:26:50.126] [driver] [info] [Task Finished] Transform to mem in 0.278816s (10985 normal rows, 43336 exceptions)
[2021-03-25 11:26:50.404] [driver] [info] [Task Finished] Transform to mem in 0.278351s (11000 normal rows, 42999 exceptions)
[2021-03-25 11:26:50.682] [driver] [info] [Task Finished] Transform to mem in 0.277933s (11052 normal rows, 42881 exceptions)
[2021-03-25 11:26:50.961] [driver] [info] [Task Finished] Transform to mem in 0.278696s (11020 normal rows, 43057 exceptions)
[2021-03-25 11:26:51.238] [driver] [info] [Task Finished] Transform to mem in 0.277225s (10995 normal rows, 42708 exceptions)
[2021-03-25 11:26:51.517] [driver] [info] [Task Finished] Transform to mem in 0.278676s (11166 normal rows, 43520 exceptions)
[2021-03-25 11:26:51.796] [driver] [info] [Task Finished] Transform to mem in 0.278862s (11098 normal rows, 43075 exceptions)
[2021-03-25 11:26:52.074] [driver] [info] [Task Finished] Transform to mem in 0.278423s (11073 normal rows, 42970 exceptions)
[2021-03-25 11:26:52.352] [driver] [info] [Task Finished] Transform to mem in 0.278010s (10999 normal rows, 43334 exceptions)
[2021-03-25 11:26:52.631] [driver] [info] [Task Finished] Transform to mem in 0.278608s (11000 normal rows, 43009 exceptions)
[2021-03-25 11:26:52.908] [driver] [info] [Task Finished] Transform to mem in 0.277595s (11052 normal rows, 42764 exceptions)
[2021-03-25 11:26:53.187] [driver] [info] [Task Finished] Transform to mem in 0.278100s (11020 normal rows, 43138 exceptions)
[2021-03-25 11:26:53.464] [driver] [info] [Task Finished] Transform to mem in 0.277799s (10995 normal rows, 42726 exceptions)
[2021-03-25 11:26:53.743] [driver] [info] [Task Finished] Transform to mem in 0.279108s (11166 normal rows, 43508 exceptions)
[2021-03-25 11:26:54.022] [driver] [info] [Task Finished] Transform to mem in 0.278534s (11091 normal rows, 43047 exceptions)
[2021-03-25 11:26:54.301] [driver] [info] [Task Finished] Transform to mem in 0.279329s (11080 normal rows, 43031 exceptions)
[2021-03-25 11:26:54.580] [driver] [info] [Task Finished] Transform to mem in 0.278479s (10999 normal rows, 43300 exceptions)
[2021-03-25 11:26:54.859] [driver] [info] [Task Finished] Transform to mem in 0.278944s (11000 normal rows, 43043 exceptions)
[2021-03-25 11:26:55.137] [driver] [info] [Task Finished] Transform to mem in 0.278326s (11036 normal rows, 42720 exceptions)
[2021-03-25 11:26:55.416] [driver] [info] [Task Finished] Transform to mem in 0.278602s (11016 normal rows, 43165 exceptions)
[2021-03-25 11:26:55.694] [driver] [info] [Task Finished] Transform to mem in 0.277972s (10995 normal rows, 42718 exceptions)
[2021-03-25 11:26:55.972] [driver] [info] [Task Finished] Transform to mem in 0.278076s (11186 normal rows, 43465 exceptions)
[2021-03-25 11:26:56.250] [driver] [info] [Task Finished] Transform to mem in 0.278215s (11001 normal rows, 43113 exceptions)
[2021-03-25 11:26:56.528] [driver] [info] [Task Finished] Transform to mem in 0.278211s (11170 normal rows, 43024 exceptions)
[2021-03-25 11:26:56.806] [driver] [info] [Task Finished] Transform to mem in 0.277732s (10989 normal rows, 43282 exceptions)
[2021-03-25 11:26:57.085] [driver] [info] [Task Finished] Transform to mem in 0.278789s (11010 normal rows, 43002 exceptions)
[2021-03-25 11:26:57.363] [driver] [info] [Task Finished] Transform to mem in 0.278481s (11002 normal rows, 42755 exceptions)
[2021-03-25 11:26:57.643] [driver] [info] [Task Finished] Transform to mem in 0.279834s (11050 normal rows, 43199 exceptions)
[2021-03-25 11:26:57.922] [driver] [info] [Task Finished] Transform to mem in 0.278948s (10973 normal rows, 42686 exceptions)
[2021-03-25 11:26:58.202] [driver] [info] [Task Finished] Transform to mem in 0.279885s (11160 normal rows, 43455 exceptions)
[2021-03-25 11:26:58.482] [driver] [info] [Task Finished] Transform to mem in 0.280067s (11045 normal rows, 43148 exceptions)
[2021-03-25 11:26:58.762] [driver] [info] [Task Finished] Transform to mem in 0.279358s (11166 normal rows, 43023 exceptions)
[2021-03-25 11:26:59.040] [driver] [info] [Task Finished] Transform to mem in 0.278499s (10997 normal rows, 43283 exceptions)
[2021-03-25 11:26:59.319] [driver] [info] [Task Finished] Transform to mem in 0.279035s (11005 normal rows, 42971 exceptions)
[2021-03-25 11:26:59.598] [driver] [info] [Task Finished] Transform to mem in 0.278524s (11007 normal rows, 42795 exceptions)
[2021-03-25 11:26:59.877] [driver] [info] [Task Finished] Transform to mem in 0.279245s (11050 normal rows, 43196 exceptions)
[2021-03-25 11:27:00.156] [driver] [info] [Task Finished] Transform to mem in 0.278717s (10973 normal rows, 42686 exceptions)
[2021-03-25 11:27:00.436] [driver] [info] [Task Finished] Transform to mem in 0.280249s (11160 normal rows, 43446 exceptions)
[2021-03-25 11:27:00.716] [driver] [info] [Task Finished] Transform to mem in 0.279569s (11043 normal rows, 43153 exceptions)
[2021-03-25 11:27:00.995] [driver] [info] [Task Finished] Transform to mem in 0.279488s (11168 normal rows, 43028 exceptions)
[2021-03-25 11:27:01.274] [driver] [info] [Task Finished] Transform to mem in 0.279320s (10997 normal rows, 43277 exceptions)
[2021-03-25 11:27:01.554] [driver] [info] [Task Finished] Transform to mem in 0.279192s (10997 normal rows, 42973 exceptions)
[2021-03-25 11:27:01.833] [driver] [info] [Task Finished] Transform to mem in 0.278985s (11015 normal rows, 42799 exceptions)
[2021-03-25 11:27:02.112] [driver] [info] [Task Finished] Transform to mem in 0.279782s (11050 normal rows, 43170 exceptions)
[2021-03-25 11:27:02.392] [driver] [info] [Task Finished] Transform to mem in 0.279649s (10973 normal rows, 42710 exceptions)
[2021-03-25 11:27:02.671] [driver] [info] [Task Finished] Transform to mem in 0.278764s (11160 normal rows, 43431 exceptions)
[2021-03-25 11:27:02.950] [driver] [info] [Task Finished] Transform to mem in 0.279206s (11043 normal rows, 43166 exceptions)
[2021-03-25 11:27:03.230] [driver] [info] [Task Finished] Transform to mem in 0.279876s (11168 normal rows, 43027 exceptions)
[2021-03-25 11:27:03.509] [driver] [info] [Task Finished] Transform to mem in 0.278953s (10997 normal rows, 43237 exceptions)
[2021-03-25 11:27:03.788] [driver] [info] [Task Finished] Transform to mem in 0.279234s (10997 normal rows, 43012 exceptions)
[2021-03-25 11:27:04.067] [driver] [info] [Task Finished] Transform to mem in 0.278855s (11009 normal rows, 42805 exceptions)
[2021-03-25 11:27:04.346] [driver] [info] [Task Finished] Transform to mem in 0.279209s (11021 normal rows, 43160 exceptions)
[2021-03-25 11:27:04.625] [driver] [info] [Task Finished] Transform to mem in 0.278597s (11003 normal rows, 42716 exceptions)
[2021-03-25 11:27:04.904] [driver] [info] [Task Finished] Transform to mem in 0.279148s (11165 normal rows, 43354 exceptions)
[2021-03-25 11:27:05.183] [driver] [info] [Task Finished] Transform to mem in 0.279060s (11043 normal rows, 43217 exceptions)
[2021-03-25 11:27:05.462] [driver] [info] [Task Finished] Transform to mem in 0.278977s (11156 normal rows, 43044 exceptions)
[2021-03-25 11:27:05.742] [driver] [info] [Task Finished] Transform to mem in 0.279447s (11009 normal rows, 43187 exceptions)
[2021-03-25 11:27:06.021] [driver] [info] [Task Finished] Transform to mem in 0.279238s (10997 normal rows, 43067 exceptions)
[2021-03-25 11:27:06.300] [driver] [info] [Task Finished] Transform to mem in 0.278852s (11009 normal rows, 42811 exceptions)
[2021-03-25 11:27:06.579] [driver] [info] [Task Finished] Transform to mem in 0.278963s (11021 normal rows, 43162 exceptions)
[2021-03-25 11:27:06.857] [driver] [info] [Task Finished] Transform to mem in 0.278681s (11003 normal rows, 42716 exceptions)
[2021-03-25 11:27:07.137] [driver] [info] [Task Finished] Transform to mem in 0.279074s (11165 normal rows, 43260 exceptions)
[2021-03-25 11:27:07.415] [driver] [info] [Task Finished] Transform to mem in 0.278920s (11027 normal rows, 43245 exceptions)
[2021-03-25 11:27:07.695] [driver] [info] [Task Finished] Transform to mem in 0.279529s (11172 normal rows, 43107 exceptions)
[2021-03-25 11:27:07.974] [driver] [info] [Task Finished] Transform to mem in 0.279068s (10997 normal rows, 43177 exceptions)
[2021-03-25 11:27:08.253] [driver] [info] [Task Finished] Transform to mem in 0.279381s (11009 normal rows, 43050 exceptions)
[2021-03-25 11:27:08.532] [driver] [info] [Task Finished] Transform to mem in 0.278690s (10999 normal rows, 42828 exceptions)
[2021-03-25 11:27:08.811] [driver] [info] [Task Finished] Transform to mem in 0.278878s (11031 normal rows, 43157 exceptions)
[2021-03-25 11:27:09.090] [driver] [info] [Task Finished] Transform to mem in 0.278729s (11000 normal rows, 42726 exceptions)
[2021-03-25 11:27:09.368] [driver] [info] [Task Finished] Transform to mem in 0.278569s (11091 normal rows, 43230 exceptions)
[2021-03-25 11:27:09.648] [driver] [info] [Task Finished] Transform to mem in 0.279239s (11099 normal rows, 43272 exceptions)
[2021-03-25 11:27:09.926] [driver] [info] [Task Finished] Transform to mem in 0.278752s (11177 normal rows, 43113 exceptions)
[2021-03-25 11:27:10.206] [driver] [info] [Task Finished] Transform to mem in 0.279881s (10997 normal rows, 43174 exceptions)
[2021-03-25 11:27:10.486] [driver] [info] [Task Finished] Transform to mem in 0.279853s (10987 normal rows, 43020 exceptions)
[2021-03-25 11:27:10.765] [driver] [info] [Task Finished] Transform to mem in 0.279026s (11020 normal rows, 42867 exceptions)
[2021-03-25 11:27:11.078] [driver] [info] [Task Finished] Transform to mem in 0.312503s (12330 normal rows, 48094 exceptions)
[2021-03-25 11:27:11.078] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 44.6277s
[2021-03-25 11:27:11.078] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.6245s, 56350770 input rows, time to process 1 row via fast path: 0.000791905ms
[2021-03-25 11:27:11.078] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 11:27:11.082] [local ee] [info] compiled pure python pipeline in 0.004209s
[2021-03-25 11:27:11.082] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 11:27:11.083] [local ee] [info] Created 160 resolve tasks in 0.001182s
[2021-03-25 11:27:11.083] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 11:27:15.423] [driver] [info] [Task Finished] Resolve in 4.339441s
[2021-03-25 11:27:19.871] [driver] [info] [Task Finished] Resolve in 4.448031s
[2021-03-25 11:27:24.222] [driver] [info] [Task Finished] Resolve in 4.350885s
[2021-03-25 11:27:28.704] [driver] [info] [Task Finished] Resolve in 4.482354s
[2021-03-25 11:27:33.134] [driver] [info] [Task Finished] Resolve in 4.429200s
[2021-03-25 11:27:37.399] [driver] [info] [Task Finished] Resolve in 4.265525s
[2021-03-25 11:27:41.866] [driver] [info] [Task Finished] Resolve in 4.467300s
[2021-03-25 11:27:46.331] [driver] [info] [Task Finished] Resolve in 4.464351s
[2021-03-25 11:27:50.627] [driver] [info] [Task Finished] Resolve in 4.296283s
[2021-03-25 11:27:55.221] [driver] [info] [Task Finished] Resolve in 4.594273s
[2021-03-25 11:27:59.489] [driver] [info] [Task Finished] Resolve in 4.267701s
[2021-03-25 11:28:03.773] [driver] [info] [Task Finished] Resolve in 4.284263s
[2021-03-25 11:28:08.391] [driver] [info] [Task Finished] Resolve in 4.617568s
[2021-03-25 11:28:12.665] [driver] [info] [Task Finished] Resolve in 4.273773s
[2021-03-25 11:28:16.963] [driver] [info] [Task Finished] Resolve in 4.298548s
[2021-03-25 11:28:21.620] [driver] [info] [Task Finished] Resolve in 4.656739s
[2021-03-25 11:28:25.908] [driver] [info] [Task Finished] Resolve in 4.287860s
[2021-03-25 11:28:30.238] [driver] [info] [Task Finished] Resolve in 4.330021s
[2021-03-25 11:28:34.504] [driver] [info] [Task Finished] Resolve in 4.265446s
[2021-03-25 11:28:39.291] [driver] [info] [Task Finished] Resolve in 4.787414s
[2021-03-25 11:28:43.576] [driver] [info] [Task Finished] Resolve in 4.285059s
[2021-03-25 11:28:47.842] [driver] [info] [Task Finished] Resolve in 4.266174s
[2021-03-25 11:28:52.135] [driver] [info] [Task Finished] Resolve in 4.292202s
[2021-03-25 11:28:56.387] [driver] [info] [Task Finished] Resolve in 4.252433s
[2021-03-25 11:29:01.288] [driver] [info] [Task Finished] Resolve in 4.901365s
[2021-03-25 11:29:05.624] [driver] [info] [Task Finished] Resolve in 4.335730s
[2021-03-25 11:29:09.888] [driver] [info] [Task Finished] Resolve in 4.263218s
[2021-03-25 11:29:14.177] [driver] [info] [Task Finished] Resolve in 4.289512s
[2021-03-25 11:29:18.463] [driver] [info] [Task Finished] Resolve in 4.285659s
[2021-03-25 11:29:23.501] [driver] [info] [Task Finished] Resolve in 5.037879s
[2021-03-25 11:29:27.790] [driver] [info] [Task Finished] Resolve in 4.289130s
[2021-03-25 11:29:32.050] [driver] [info] [Task Finished] Resolve in 4.259864s
[2021-03-25 11:29:36.320] [driver] [info] [Task Finished] Resolve in 4.270344s
[2021-03-25 11:29:40.671] [driver] [info] [Task Finished] Resolve in 4.351307s
[2021-03-25 11:29:44.940] [driver] [info] [Task Finished] Resolve in 4.268062s
[2021-03-25 11:29:49.229] [driver] [info] [Task Finished] Resolve in 4.289543s
[2021-03-25 11:29:53.514] [driver] [info] [Task Finished] Resolve in 4.284979s
[2021-03-25 11:29:58.753] [driver] [info] [Task Finished] Resolve in 5.239212s
[2021-03-25 11:30:03.043] [driver] [info] [Task Finished] Resolve in 4.289993s
[2021-03-25 11:30:07.307] [driver] [info] [Task Finished] Resolve in 4.263433s
[2021-03-25 11:30:11.575] [driver] [info] [Task Finished] Resolve in 4.267954s
[2021-03-25 11:30:15.933] [driver] [info] [Task Finished] Resolve in 4.358457s
[2021-03-25 11:30:20.210] [driver] [info] [Task Finished] Resolve in 4.276971s
[2021-03-25 11:30:24.500] [driver] [info] [Task Finished] Resolve in 4.289736s
[2021-03-25 11:30:28.789] [driver] [info] [Task Finished] Resolve in 4.288473s
[2021-03-25 11:30:33.059] [driver] [info] [Task Finished] Resolve in 4.270695s
[2021-03-25 11:30:38.641] [driver] [info] [Task Finished] Resolve in 5.581129s
[2021-03-25 11:30:43.065] [driver] [info] [Task Finished] Resolve in 4.424023s
[2021-03-25 11:30:47.489] [driver] [info] [Task Finished] Resolve in 4.424013s
[2021-03-25 11:30:51.999] [driver] [info] [Task Finished] Resolve in 4.510272s
[2021-03-25 11:30:56.440] [driver] [info] [Task Finished] Resolve in 4.441337s
[2021-03-25 11:31:00.887] [driver] [info] [Task Finished] Resolve in 4.447044s
[2021-03-25 11:31:05.338] [driver] [info] [Task Finished] Resolve in 4.450407s
[2021-03-25 11:31:09.775] [driver] [info] [Task Finished] Resolve in 4.436914s
[2021-03-25 11:31:14.224] [driver] [info] [Task Finished] Resolve in 4.449596s
[2021-03-25 11:31:18.648] [driver] [info] [Task Finished] Resolve in 4.423251s
[2021-03-25 11:31:23.066] [driver] [info] [Task Finished] Resolve in 4.418118s
[2021-03-25 11:31:29.083] [driver] [info] [Task Finished] Resolve in 6.017050s
[2021-03-25 11:31:33.522] [driver] [info] [Task Finished] Resolve in 4.439403s
[2021-03-25 11:31:37.975] [driver] [info] [Task Finished] Resolve in 4.452476s
[2021-03-25 11:31:42.438] [driver] [info] [Task Finished] Resolve in 4.463162s
[2021-03-25 11:31:46.880] [driver] [info] [Task Finished] Resolve in 4.442190s
[2021-03-25 11:31:51.335] [driver] [info] [Task Finished] Resolve in 4.454704s
[2021-03-25 11:31:55.765] [driver] [info] [Task Finished] Resolve in 4.429587s
[2021-03-25 11:32:00.182] [driver] [info] [Task Finished] Resolve in 4.417520s
[2021-03-25 11:32:04.703] [driver] [info] [Task Finished] Resolve in 4.520305s
[2021-03-25 11:32:09.144] [driver] [info] [Task Finished] Resolve in 4.441814s
[2021-03-25 11:32:13.595] [driver] [info] [Task Finished] Resolve in 4.450864s
[2021-03-25 11:32:18.055] [driver] [info] [Task Finished] Resolve in 4.459407s
[2021-03-25 11:32:22.498] [driver] [info] [Task Finished] Resolve in 4.443014s
[2021-03-25 11:32:26.949] [driver] [info] [Task Finished] Resolve in 4.450692s
[2021-03-25 11:32:33.240] [driver] [info] [Task Finished] Resolve in 6.291883s
[2021-03-25 11:32:37.658] [driver] [info] [Task Finished] Resolve in 4.417804s
[2021-03-25 11:32:42.181] [driver] [info] [Task Finished] Resolve in 4.522172s
[2021-03-25 11:32:46.623] [driver] [info] [Task Finished] Resolve in 4.442062s
[2021-03-25 11:32:51.065] [driver] [info] [Task Finished] Resolve in 4.442689s
[2021-03-25 11:32:55.530] [driver] [info] [Task Finished] Resolve in 4.464233s
[2021-03-25 11:32:59.970] [driver] [info] [Task Finished] Resolve in 4.440751s
[2021-03-25 11:33:04.419] [driver] [info] [Task Finished] Resolve in 4.448123s
[2021-03-25 11:33:08.851] [driver] [info] [Task Finished] Resolve in 4.431989s
[2021-03-25 11:33:13.265] [driver] [info] [Task Finished] Resolve in 4.414616s
[2021-03-25 11:33:17.784] [driver] [info] [Task Finished] Resolve in 4.518848s
[2021-03-25 11:33:22.228] [driver] [info] [Task Finished] Resolve in 4.444255s
[2021-03-25 11:33:26.664] [driver] [info] [Task Finished] Resolve in 4.435486s
[2021-03-25 11:33:31.136] [driver] [info] [Task Finished] Resolve in 4.472513s
[2021-03-25 11:33:35.581] [driver] [info] [Task Finished] Resolve in 4.444045s
[2021-03-25 11:33:40.020] [driver] [info] [Task Finished] Resolve in 4.439161s
[2021-03-25 11:33:44.465] [driver] [info] [Task Finished] Resolve in 4.444680s
[2021-03-25 11:33:48.883] [driver] [info] [Task Finished] Resolve in 4.418649s
[2021-03-25 11:33:55.706] [driver] [info] [Task Finished] Resolve in 6.822514s
[2021-03-25 11:34:00.145] [driver] [info] [Task Finished] Resolve in 4.439521s
[2021-03-25 11:34:04.583] [driver] [info] [Task Finished] Resolve in 4.437365s
[2021-03-25 11:34:09.062] [driver] [info] [Task Finished] Resolve in 4.478939s
[2021-03-25 11:34:13.506] [driver] [info] [Task Finished] Resolve in 4.444183s
[2021-03-25 11:34:17.926] [driver] [info] [Task Finished] Resolve in 4.420039s
[2021-03-25 11:34:22.382] [driver] [info] [Task Finished] Resolve in 4.456142s
[2021-03-25 11:34:26.799] [driver] [info] [Task Finished] Resolve in 4.416474s
[2021-03-25 11:34:31.317] [driver] [info] [Task Finished] Resolve in 4.518787s
[2021-03-25 11:34:35.762] [driver] [info] [Task Finished] Resolve in 4.444606s
[2021-03-25 11:34:40.201] [driver] [info] [Task Finished] Resolve in 4.439064s
[2021-03-25 11:34:44.670] [driver] [info] [Task Finished] Resolve in 4.468910s
[2021-03-25 11:34:49.121] [driver] [info] [Task Finished] Resolve in 4.451180s
[2021-03-25 11:34:53.537] [driver] [info] [Task Finished] Resolve in 4.415512s
[2021-03-25 11:34:57.998] [driver] [info] [Task Finished] Resolve in 4.460749s
[2021-03-25 11:35:02.413] [driver] [info] [Task Finished] Resolve in 4.415134s
[2021-03-25 11:35:06.930] [driver] [info] [Task Finished] Resolve in 4.517267s
[2021-03-25 11:35:11.378] [driver] [info] [Task Finished] Resolve in 4.447866s
[2021-03-25 11:35:15.820] [driver] [info] [Task Finished] Resolve in 4.442291s
[2021-03-25 11:35:20.291] [driver] [info] [Task Finished] Resolve in 4.470755s
[2021-03-25 11:35:24.728] [driver] [info] [Task Finished] Resolve in 4.436783s
[2021-03-25 11:35:29.150] [driver] [info] [Task Finished] Resolve in 4.421664s
[2021-03-25 11:35:36.490] [driver] [info] [Task Finished] Resolve in 7.339887s
[2021-03-25 11:35:40.901] [driver] [info] [Task Finished] Resolve in 4.411784s
[2021-03-25 11:35:45.420] [driver] [info] [Task Finished] Resolve in 4.518218s
[2021-03-25 11:35:49.873] [driver] [info] [Task Finished] Resolve in 4.453546s
[2021-03-25 11:35:54.317] [driver] [info] [Task Finished] Resolve in 4.443287s
[2021-03-25 11:35:58.792] [driver] [info] [Task Finished] Resolve in 4.475086s
[2021-03-25 11:36:03.233] [driver] [info] [Task Finished] Resolve in 4.441526s
[2021-03-25 11:36:07.661] [driver] [info] [Task Finished] Resolve in 4.427850s
[2021-03-25 11:36:12.130] [driver] [info] [Task Finished] Resolve in 4.468994s
[2021-03-25 11:36:16.544] [driver] [info] [Task Finished] Resolve in 4.413468s
[2021-03-25 11:36:21.063] [driver] [info] [Task Finished] Resolve in 4.519260s
[2021-03-25 11:36:25.516] [driver] [info] [Task Finished] Resolve in 4.452967s
[2021-03-25 11:36:29.956] [driver] [info] [Task Finished] Resolve in 4.439846s
[2021-03-25 11:36:34.431] [driver] [info] [Task Finished] Resolve in 4.475458s
[2021-03-25 11:36:38.870] [driver] [info] [Task Finished] Resolve in 4.438520s
[2021-03-25 11:36:43.302] [driver] [info] [Task Finished] Resolve in 4.431635s
[2021-03-25 11:36:47.769] [driver] [info] [Task Finished] Resolve in 4.467250s
[2021-03-25 11:36:52.184] [driver] [info] [Task Finished] Resolve in 4.415295s
[2021-03-25 11:36:56.698] [driver] [info] [Task Finished] Resolve in 4.513684s
[2021-03-25 11:37:01.150] [driver] [info] [Task Finished] Resolve in 4.452448s
[2021-03-25 11:37:05.593] [driver] [info] [Task Finished] Resolve in 4.442189s
[2021-03-25 11:37:10.059] [driver] [info] [Task Finished] Resolve in 4.466702s
[2021-03-25 11:37:14.503] [driver] [info] [Task Finished] Resolve in 4.443476s
[2021-03-25 11:37:18.930] [driver] [info] [Task Finished] Resolve in 4.427409s
[2021-03-25 11:37:23.398] [driver] [info] [Task Finished] Resolve in 4.467254s
[2021-03-25 11:37:27.809] [driver] [info] [Task Finished] Resolve in 4.411329s
[2021-03-25 11:37:32.312] [driver] [info] [Task Finished] Resolve in 4.502804s
[2021-03-25 11:37:40.330] [driver] [info] [Task Finished] Resolve in 8.018555s
[2021-03-25 11:37:44.772] [driver] [info] [Task Finished] Resolve in 4.441913s
[2021-03-25 11:37:49.234] [driver] [info] [Task Finished] Resolve in 4.461507s
[2021-03-25 11:37:53.678] [driver] [info] [Task Finished] Resolve in 4.444248s
[2021-03-25 11:37:58.106] [driver] [info] [Task Finished] Resolve in 4.427593s
[2021-03-25 11:38:02.572] [driver] [info] [Task Finished] Resolve in 4.466113s
[2021-03-25 11:38:06.983] [driver] [info] [Task Finished] Resolve in 4.410762s
[2021-03-25 11:38:11.470] [driver] [info] [Task Finished] Resolve in 4.486889s
[2021-03-25 11:38:15.937] [driver] [info] [Task Finished] Resolve in 4.467327s
[2021-03-25 11:38:20.382] [driver] [info] [Task Finished] Resolve in 4.444440s
[2021-03-25 11:38:24.839] [driver] [info] [Task Finished] Resolve in 4.456874s
[2021-03-25 11:38:29.282] [driver] [info] [Task Finished] Resolve in 4.443648s
[2021-03-25 11:38:33.708] [driver] [info] [Task Finished] Resolve in 4.425564s
[2021-03-25 11:38:38.172] [driver] [info] [Task Finished] Resolve in 4.464538s
[2021-03-25 11:38:42.584] [driver] [info] [Task Finished] Resolve in 4.411910s
[2021-03-25 11:38:47.066] [driver] [info] [Task Finished] Resolve in 4.482106s
[2021-03-25 11:38:51.539] [driver] [info] [Task Finished] Resolve in 4.472292s
[2021-03-25 11:38:55.987] [driver] [info] [Task Finished] Resolve in 4.447981s
[2021-03-25 11:39:00.445] [driver] [info] [Task Finished] Resolve in 4.457950s
[2021-03-25 11:39:04.886] [driver] [info] [Task Finished] Resolve in 4.440789s
[2021-03-25 11:39:09.320] [driver] [info] [Task Finished] Resolve in 4.434677s
[2021-03-25 11:39:14.289] [driver] [info] [Task Finished] Resolve in 4.968861s
[2021-03-25 11:39:14.289] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 723.211s
[2021-03-25 11:39:14.289] [local ee] [info] slow path for Stage 0: total wall clock time: 723.2s, time to process 1 row via slow path: 0.104874ms
[2021-03-25 11:39:14.289] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 723.212s

[2021-03-25 11:39:14.323] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-25 11:39:14.566] [driver] [info] [Task Finished] write to file in 0.243096s (1798491 rows, 273.61 MB)
[2021-03-25 11:39:14.566] [global] [info] writing output took 0.276585s
[2021-03-25 11:39:14.566] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.276676s
[2021-03-25 11:39:14.566] [global] [info] [Transform Stage] Stage 0 took 768.614s
[2021-03-25 11:39:14.566] [global] [info] Query Execution took 768.692s. (planning: 0.0783035s, execution: 768.614s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005015373229980469
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 768.9690709114075 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0219872,"llvm_optimization_time_s":0.329777,"llvm_compilation_time_s":0.151092,"total_compilation_time_s":0.498213,"sampling_time_s":0.109659,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.6245,"fast_path_time_s":44.6277,"fast_path_per_row_time_ns":791.905,"slow_path_wall_time_s":723.2,"slow_path_time_s":723.211,"slow_path_per_row_time_ns":104874}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.005015373229980469, "jobTime": 768.9690709114075, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
