[2021-03-25 11:13:37.622] [global] [error] could not find backend, defaulting to local
[2021-03-25 11:13:37.622] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 11:13:37.622] [local ee] [info] initializing LLVM backend
[2021-03-25 11:13:37.622] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 11:13:37.622] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 11:13:37.623] [memory] [info] allocated bitmap managed memory region (32.00 GB, 32.00 MB block size)
[2021-03-25 11:13:37.623] [local execution engine] [info] started driver (32.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 11:13:37.623] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 11:13:37.623] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 11:13:37.758] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:13:37.764] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:13:37.780] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:13:37.788] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:13:37.814] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:13:37.834] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:13:37.847] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:13:37.878] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 11:13:37.884] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:13:37.899] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:13:37.901] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:13:37.902] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:13:37.903] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:13:37.904] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:13:37.905] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:13:37.906] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:13:37.907] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:13:37.909] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 11:13:37.909] [global] [info] performing static typing for UDF in operator map
[2021-03-25 11:13:37.925] [logical planner] [info] logical optimization took 0.021946ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 11:13:37.925] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:13:37.926] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:13:37.927] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 11:13:37.927] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 11:13:37.928] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 11:13:37.928] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 11:13:37.929] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 11:13:37.930] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 11:13:37.931] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 11:13:37.932] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 11:13:37.932] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:13:37.934] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:13:37.934] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:13:37.935] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:13:37.936] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:13:37.937] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 11:13:37.938] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 11:13:37.938] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 11:13:37.939] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 11:13:37.939] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 11:13:37.940] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 11:13:37.941] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 11:13:37.942] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 11:13:37.943] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 11:13:37.943] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:13:37.945] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 11:13:37.945] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:13:37.946] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 11:13:37.946] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 11:13:37.978] [global] [info] Stage0 depends on: 
[2021-03-25 11:13:38.327] [global] [info] Optimization via LLVM passes took 0.331453 ms
[2021-03-25 11:13:38.478] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 11:13:38.478] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.499793s
[2021-03-25 11:13:38.478] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 11:13:38.778] [driver] [info] [Task Finished] Transform to mem in 0.299510s (11105 normal rows, 43095 exceptions)
[2021-03-25 11:13:39.076] [driver] [info] [Task Finished] Transform to mem in 0.297611s (11073 normal rows, 43414 exceptions)
[2021-03-25 11:13:39.374] [driver] [info] [Task Finished] Transform to mem in 0.298186s (11153 normal rows, 42970 exceptions)
[2021-03-25 11:13:39.672] [driver] [info] [Task Finished] Transform to mem in 0.298071s (11047 normal rows, 43210 exceptions)
[2021-03-25 11:13:39.970] [driver] [info] [Task Finished] Transform to mem in 0.297729s (10987 normal rows, 43113 exceptions)
[2021-03-25 11:13:40.267] [driver] [info] [Task Finished] Transform to mem in 0.297268s (10997 normal rows, 42873 exceptions)
[2021-03-25 11:13:40.564] [driver] [info] [Task Finished] Transform to mem in 0.297416s (11036 normal rows, 43142 exceptions)
[2021-03-25 11:13:40.862] [driver] [info] [Task Finished] Transform to mem in 0.297278s (11005 normal rows, 42741 exceptions)
[2021-03-25 11:13:41.159] [driver] [info] [Task Finished] Transform to mem in 0.297196s (11086 normal rows, 43015 exceptions)
[2021-03-25 11:13:41.456] [driver] [info] [Task Finished] Transform to mem in 0.297053s (11092 normal rows, 43495 exceptions)
[2021-03-25 11:13:41.753] [driver] [info] [Task Finished] Transform to mem in 0.297324s (11153 normal rows, 42968 exceptions)
[2021-03-25 11:13:42.050] [driver] [info] [Task Finished] Transform to mem in 0.297162s (11026 normal rows, 43206 exceptions)
[2021-03-25 11:13:42.347] [driver] [info] [Task Finished] Transform to mem in 0.296850s (11008 normal rows, 43077 exceptions)
[2021-03-25 11:13:42.645] [driver] [info] [Task Finished] Transform to mem in 0.297171s (10997 normal rows, 42910 exceptions)
[2021-03-25 11:13:42.941] [driver] [info] [Task Finished] Transform to mem in 0.296927s (11036 normal rows, 43139 exceptions)
[2021-03-25 11:13:43.238] [driver] [info] [Task Finished] Transform to mem in 0.296850s (11005 normal rows, 42744 exceptions)
[2021-03-25 11:13:43.535] [driver] [info] [Task Finished] Transform to mem in 0.296490s (11086 normal rows, 42996 exceptions)
[2021-03-25 11:13:43.832] [driver] [info] [Task Finished] Transform to mem in 0.296891s (11092 normal rows, 43505 exceptions)
[2021-03-25 11:13:44.129] [driver] [info] [Task Finished] Transform to mem in 0.296942s (11153 normal rows, 42978 exceptions)
[2021-03-25 11:13:44.425] [driver] [info] [Task Finished] Transform to mem in 0.296483s (11026 normal rows, 43205 exceptions)
[2021-03-25 11:13:44.722] [driver] [info] [Task Finished] Transform to mem in 0.297237s (10982 normal rows, 43059 exceptions)
[2021-03-25 11:13:45.020] [driver] [info] [Task Finished] Transform to mem in 0.297044s (11023 normal rows, 42910 exceptions)
[2021-03-25 11:13:45.316] [driver] [info] [Task Finished] Transform to mem in 0.296566s (11036 normal rows, 43115 exceptions)
[2021-03-25 11:13:45.613] [driver] [info] [Task Finished] Transform to mem in 0.297078s (11005 normal rows, 42772 exceptions)
[2021-03-25 11:13:45.911] [driver] [info] [Task Finished] Transform to mem in 0.297310s (11086 normal rows, 42970 exceptions)
[2021-03-25 11:13:46.208] [driver] [info] [Task Finished] Transform to mem in 0.297100s (11079 normal rows, 43539 exceptions)
[2021-03-25 11:13:46.505] [driver] [info] [Task Finished] Transform to mem in 0.297145s (11111 normal rows, 42961 exceptions)
[2021-03-25 11:13:46.802] [driver] [info] [Task Finished] Transform to mem in 0.296941s (11076 normal rows, 43220 exceptions)
[2021-03-25 11:13:47.099] [driver] [info] [Task Finished] Transform to mem in 0.297185s (10987 normal rows, 43068 exceptions)
[2021-03-25 11:13:47.396] [driver] [info] [Task Finished] Transform to mem in 0.296554s (11023 normal rows, 42880 exceptions)
[2021-03-25 11:13:47.693] [driver] [info] [Task Finished] Transform to mem in 0.297156s (11036 normal rows, 43053 exceptions)
[2021-03-25 11:13:47.989] [driver] [info] [Task Finished] Transform to mem in 0.296568s (10992 normal rows, 42864 exceptions)
[2021-03-25 11:13:48.286] [driver] [info] [Task Finished] Transform to mem in 0.296527s (11099 normal rows, 42882 exceptions)
[2021-03-25 11:13:48.583] [driver] [info] [Task Finished] Transform to mem in 0.297198s (11063 normal rows, 43617 exceptions)
[2021-03-25 11:13:48.880] [driver] [info] [Task Finished] Transform to mem in 0.297129s (11127 normal rows, 42969 exceptions)
[2021-03-25 11:13:49.177] [driver] [info] [Task Finished] Transform to mem in 0.296856s (11076 normal rows, 43221 exceptions)
[2021-03-25 11:13:49.474] [driver] [info] [Task Finished] Transform to mem in 0.297320s (10987 normal rows, 43063 exceptions)
[2021-03-25 11:13:49.771] [driver] [info] [Task Finished] Transform to mem in 0.297016s (11004 normal rows, 42876 exceptions)
[2021-03-25 11:13:50.069] [driver] [info] [Task Finished] Transform to mem in 0.297484s (11026 normal rows, 43041 exceptions)
[2021-03-25 11:13:50.366] [driver] [info] [Task Finished] Transform to mem in 0.296600s (11021 normal rows, 42887 exceptions)
[2021-03-25 11:13:50.662] [driver] [info] [Task Finished] Transform to mem in 0.296768s (11064 normal rows, 42832 exceptions)
[2021-03-25 11:13:50.960] [driver] [info] [Task Finished] Transform to mem in 0.297458s (11098 normal rows, 43603 exceptions)
[2021-03-25 11:13:51.257] [driver] [info] [Task Finished] Transform to mem in 0.296974s (11127 normal rows, 43028 exceptions)
[2021-03-25 11:13:51.554] [driver] [info] [Task Finished] Transform to mem in 0.297307s (11076 normal rows, 43212 exceptions)
[2021-03-25 11:13:51.852] [driver] [info] [Task Finished] Transform to mem in 0.297482s (10987 normal rows, 43041 exceptions)
[2021-03-25 11:13:52.149] [driver] [info] [Task Finished] Transform to mem in 0.297412s (11004 normal rows, 42913 exceptions)
[2021-03-25 11:13:52.447] [driver] [info] [Task Finished] Transform to mem in 0.297483s (11026 normal rows, 43037 exceptions)
[2021-03-25 11:13:52.745] [driver] [info] [Task Finished] Transform to mem in 0.298018s (11012 normal rows, 42883 exceptions)
[2021-03-25 11:13:53.041] [driver] [info] [Task Finished] Transform to mem in 0.296841s (11073 normal rows, 42820 exceptions)
[2021-03-25 11:13:53.339] [driver] [info] [Task Finished] Transform to mem in 0.297451s (11095 normal rows, 43503 exceptions)
[2021-03-25 11:13:53.636] [driver] [info] [Task Finished] Transform to mem in 0.297210s (11130 normal rows, 43084 exceptions)
[2021-03-25 11:13:53.933] [driver] [info] [Task Finished] Transform to mem in 0.296810s (11076 normal rows, 43152 exceptions)
[2021-03-25 11:13:54.230] [driver] [info] [Task Finished] Transform to mem in 0.297283s (10976 normal rows, 43110 exceptions)
[2021-03-25 11:13:54.528] [driver] [info] [Task Finished] Transform to mem in 0.297432s (11015 normal rows, 42966 exceptions)
[2021-03-25 11:13:54.824] [driver] [info] [Task Finished] Transform to mem in 0.296426s (11026 normal rows, 43035 exceptions)
[2021-03-25 11:13:55.122] [driver] [info] [Task Finished] Transform to mem in 0.297393s (11012 normal rows, 42888 exceptions)
[2021-03-25 11:13:55.418] [driver] [info] [Task Finished] Transform to mem in 0.296497s (11073 normal rows, 42754 exceptions)
[2021-03-25 11:13:55.716] [driver] [info] [Task Finished] Transform to mem in 0.297495s (11095 normal rows, 43552 exceptions)
[2021-03-25 11:13:56.012] [driver] [info] [Task Finished] Transform to mem in 0.296869s (11130 normal rows, 43033 exceptions)
[2021-03-25 11:13:56.310] [driver] [info] [Task Finished] Transform to mem in 0.297172s (11069 normal rows, 43142 exceptions)
[2021-03-25 11:13:56.606] [driver] [info] [Task Finished] Transform to mem in 0.296802s (10974 normal rows, 43172 exceptions)
[2021-03-25 11:13:56.903] [driver] [info] [Task Finished] Transform to mem in 0.296954s (11008 normal rows, 42964 exceptions)
[2021-03-25 11:13:57.200] [driver] [info] [Task Finished] Transform to mem in 0.296777s (11042 normal rows, 43023 exceptions)
[2021-03-25 11:13:57.498] [driver] [info] [Task Finished] Transform to mem in 0.297654s (11012 normal rows, 42911 exceptions)
[2021-03-25 11:13:57.794] [driver] [info] [Task Finished] Transform to mem in 0.296497s (11063 normal rows, 42726 exceptions)
[2021-03-25 11:13:58.092] [driver] [info] [Task Finished] Transform to mem in 0.297701s (11105 normal rows, 43555 exceptions)
[2021-03-25 11:13:58.389] [driver] [info] [Task Finished] Transform to mem in 0.296901s (11081 normal rows, 43050 exceptions)
[2021-03-25 11:13:58.686] [driver] [info] [Task Finished] Transform to mem in 0.296875s (11087 normal rows, 43150 exceptions)
[2021-03-25 11:13:58.982] [driver] [info] [Task Finished] Transform to mem in 0.296361s (11005 normal rows, 43164 exceptions)
[2021-03-25 11:13:59.279] [driver] [info] [Task Finished] Transform to mem in 0.296998s (11008 normal rows, 42975 exceptions)
[2021-03-25 11:13:59.576] [driver] [info] [Task Finished] Transform to mem in 0.296967s (11042 normal rows, 42959 exceptions)
[2021-03-25 11:13:59.873] [driver] [info] [Task Finished] Transform to mem in 0.296712s (11002 normal rows, 42964 exceptions)
[2021-03-25 11:14:00.170] [driver] [info] [Task Finished] Transform to mem in 0.296783s (11073 normal rows, 42720 exceptions)
[2021-03-25 11:14:00.467] [driver] [info] [Task Finished] Transform to mem in 0.296986s (11088 normal rows, 43511 exceptions)
[2021-03-25 11:14:00.764] [driver] [info] [Task Finished] Transform to mem in 0.297502s (11098 normal rows, 43112 exceptions)
[2021-03-25 11:14:01.062] [driver] [info] [Task Finished] Transform to mem in 0.297412s (11087 normal rows, 43044 exceptions)
[2021-03-25 11:14:01.359] [driver] [info] [Task Finished] Transform to mem in 0.296919s (11005 normal rows, 43229 exceptions)
[2021-03-25 11:14:01.656] [driver] [info] [Task Finished] Transform to mem in 0.297180s (11008 normal rows, 43017 exceptions)
[2021-03-25 11:14:01.952] [driver] [info] [Task Finished] Transform to mem in 0.296309s (11024 normal rows, 42947 exceptions)
[2021-03-25 11:14:02.250] [driver] [info] [Task Finished] Transform to mem in 0.297177s (11020 normal rows, 42976 exceptions)
[2021-03-25 11:14:02.546] [driver] [info] [Task Finished] Transform to mem in 0.296409s (11036 normal rows, 42710 exceptions)
[2021-03-25 11:14:02.844] [driver] [info] [Task Finished] Transform to mem in 0.297570s (11125 normal rows, 43517 exceptions)
[2021-03-25 11:14:03.141] [driver] [info] [Task Finished] Transform to mem in 0.297567s (11098 normal rows, 43115 exceptions)
[2021-03-25 11:14:03.438] [driver] [info] [Task Finished] Transform to mem in 0.296695s (11087 normal rows, 42938 exceptions)
[2021-03-25 11:14:03.735] [driver] [info] [Task Finished] Transform to mem in 0.297349s (10985 normal rows, 43336 exceptions)
[2021-03-25 11:14:04.033] [driver] [info] [Task Finished] Transform to mem in 0.297451s (11000 normal rows, 42999 exceptions)
[2021-03-25 11:14:04.329] [driver] [info] [Task Finished] Transform to mem in 0.296593s (11052 normal rows, 42881 exceptions)
[2021-03-25 11:14:04.626] [driver] [info] [Task Finished] Transform to mem in 0.296792s (11020 normal rows, 43057 exceptions)
[2021-03-25 11:14:04.922] [driver] [info] [Task Finished] Transform to mem in 0.296343s (10995 normal rows, 42708 exceptions)
[2021-03-25 11:14:05.220] [driver] [info] [Task Finished] Transform to mem in 0.297949s (11166 normal rows, 43520 exceptions)
[2021-03-25 11:14:05.517] [driver] [info] [Task Finished] Transform to mem in 0.296691s (11098 normal rows, 43075 exceptions)
[2021-03-25 11:14:05.814] [driver] [info] [Task Finished] Transform to mem in 0.296856s (11073 normal rows, 42970 exceptions)
[2021-03-25 11:14:06.112] [driver] [info] [Task Finished] Transform to mem in 0.297728s (10999 normal rows, 43334 exceptions)
[2021-03-25 11:14:06.409] [driver] [info] [Task Finished] Transform to mem in 0.296856s (11000 normal rows, 43009 exceptions)
[2021-03-25 11:14:06.705] [driver] [info] [Task Finished] Transform to mem in 0.296813s (11052 normal rows, 42764 exceptions)
[2021-03-25 11:14:07.003] [driver] [info] [Task Finished] Transform to mem in 0.297419s (11020 normal rows, 43138 exceptions)
[2021-03-25 11:14:07.300] [driver] [info] [Task Finished] Transform to mem in 0.296944s (10995 normal rows, 42726 exceptions)
[2021-03-25 11:14:07.599] [driver] [info] [Task Finished] Transform to mem in 0.299063s (11166 normal rows, 43508 exceptions)
[2021-03-25 11:14:07.896] [driver] [info] [Task Finished] Transform to mem in 0.297173s (11091 normal rows, 43047 exceptions)
[2021-03-25 11:14:08.194] [driver] [info] [Task Finished] Transform to mem in 0.297557s (11080 normal rows, 43031 exceptions)
[2021-03-25 11:14:08.491] [driver] [info] [Task Finished] Transform to mem in 0.297714s (10999 normal rows, 43300 exceptions)
[2021-03-25 11:14:08.789] [driver] [info] [Task Finished] Transform to mem in 0.297711s (11000 normal rows, 43043 exceptions)
[2021-03-25 11:14:09.086] [driver] [info] [Task Finished] Transform to mem in 0.296458s (11036 normal rows, 42720 exceptions)
[2021-03-25 11:14:09.382] [driver] [info] [Task Finished] Transform to mem in 0.296708s (11016 normal rows, 43165 exceptions)
[2021-03-25 11:14:09.679] [driver] [info] [Task Finished] Transform to mem in 0.296886s (10995 normal rows, 42718 exceptions)
[2021-03-25 11:14:09.977] [driver] [info] [Task Finished] Transform to mem in 0.297360s (11186 normal rows, 43465 exceptions)
[2021-03-25 11:14:10.274] [driver] [info] [Task Finished] Transform to mem in 0.297373s (11001 normal rows, 43113 exceptions)
[2021-03-25 11:14:10.571] [driver] [info] [Task Finished] Transform to mem in 0.297368s (11170 normal rows, 43024 exceptions)
[2021-03-25 11:14:10.868] [driver] [info] [Task Finished] Transform to mem in 0.296863s (10989 normal rows, 43282 exceptions)
[2021-03-25 11:14:11.166] [driver] [info] [Task Finished] Transform to mem in 0.297359s (11010 normal rows, 43002 exceptions)
[2021-03-25 11:14:11.463] [driver] [info] [Task Finished] Transform to mem in 0.297016s (11002 normal rows, 42755 exceptions)
[2021-03-25 11:14:11.761] [driver] [info] [Task Finished] Transform to mem in 0.298124s (11050 normal rows, 43199 exceptions)
[2021-03-25 11:14:12.058] [driver] [info] [Task Finished] Transform to mem in 0.297415s (10973 normal rows, 42686 exceptions)
[2021-03-25 11:14:12.357] [driver] [info] [Task Finished] Transform to mem in 0.298497s (11160 normal rows, 43455 exceptions)
[2021-03-25 11:14:12.655] [driver] [info] [Task Finished] Transform to mem in 0.298610s (11045 normal rows, 43148 exceptions)
[2021-03-25 11:14:12.954] [driver] [info] [Task Finished] Transform to mem in 0.298379s (11166 normal rows, 43023 exceptions)
[2021-03-25 11:14:13.252] [driver] [info] [Task Finished] Transform to mem in 0.297715s (10997 normal rows, 43283 exceptions)
[2021-03-25 11:14:13.549] [driver] [info] [Task Finished] Transform to mem in 0.297674s (11005 normal rows, 42971 exceptions)
[2021-03-25 11:14:13.847] [driver] [info] [Task Finished] Transform to mem in 0.297760s (11007 normal rows, 42795 exceptions)
[2021-03-25 11:14:14.145] [driver] [info] [Task Finished] Transform to mem in 0.298366s (11050 normal rows, 43196 exceptions)
[2021-03-25 11:14:14.443] [driver] [info] [Task Finished] Transform to mem in 0.297416s (10973 normal rows, 42686 exceptions)
[2021-03-25 11:14:14.741] [driver] [info] [Task Finished] Transform to mem in 0.298369s (11160 normal rows, 43446 exceptions)
[2021-03-25 11:14:15.040] [driver] [info] [Task Finished] Transform to mem in 0.298386s (11043 normal rows, 43153 exceptions)
[2021-03-25 11:14:15.337] [driver] [info] [Task Finished] Transform to mem in 0.297790s (11168 normal rows, 43028 exceptions)
[2021-03-25 11:14:15.635] [driver] [info] [Task Finished] Transform to mem in 0.297593s (10997 normal rows, 43277 exceptions)
[2021-03-25 11:14:15.933] [driver] [info] [Task Finished] Transform to mem in 0.298041s (10997 normal rows, 42973 exceptions)
[2021-03-25 11:14:16.231] [driver] [info] [Task Finished] Transform to mem in 0.297668s (11015 normal rows, 42799 exceptions)
[2021-03-25 11:14:16.529] [driver] [info] [Task Finished] Transform to mem in 0.298199s (11050 normal rows, 43170 exceptions)
[2021-03-25 11:14:16.827] [driver] [info] [Task Finished] Transform to mem in 0.298326s (10973 normal rows, 42710 exceptions)
[2021-03-25 11:14:17.126] [driver] [info] [Task Finished] Transform to mem in 0.298367s (11160 normal rows, 43431 exceptions)
[2021-03-25 11:14:17.423] [driver] [info] [Task Finished] Transform to mem in 0.297551s (11043 normal rows, 43166 exceptions)
[2021-03-25 11:14:17.722] [driver] [info] [Task Finished] Transform to mem in 0.298586s (11168 normal rows, 43027 exceptions)
[2021-03-25 11:14:18.020] [driver] [info] [Task Finished] Transform to mem in 0.297605s (10997 normal rows, 43237 exceptions)
[2021-03-25 11:14:18.317] [driver] [info] [Task Finished] Transform to mem in 0.297349s (10997 normal rows, 43012 exceptions)
[2021-03-25 11:14:18.615] [driver] [info] [Task Finished] Transform to mem in 0.297716s (11009 normal rows, 42805 exceptions)
[2021-03-25 11:14:18.913] [driver] [info] [Task Finished] Transform to mem in 0.297811s (11021 normal rows, 43160 exceptions)
[2021-03-25 11:14:19.210] [driver] [info] [Task Finished] Transform to mem in 0.297600s (11003 normal rows, 42716 exceptions)
[2021-03-25 11:14:19.509] [driver] [info] [Task Finished] Transform to mem in 0.298507s (11165 normal rows, 43354 exceptions)
[2021-03-25 11:14:19.806] [driver] [info] [Task Finished] Transform to mem in 0.297606s (11043 normal rows, 43217 exceptions)
[2021-03-25 11:14:20.104] [driver] [info] [Task Finished] Transform to mem in 0.297630s (11156 normal rows, 43044 exceptions)
[2021-03-25 11:14:20.402] [driver] [info] [Task Finished] Transform to mem in 0.297946s (11009 normal rows, 43187 exceptions)
[2021-03-25 11:14:20.700] [driver] [info] [Task Finished] Transform to mem in 0.298065s (10997 normal rows, 43067 exceptions)
[2021-03-25 11:14:20.997] [driver] [info] [Task Finished] Transform to mem in 0.297095s (11009 normal rows, 42811 exceptions)
[2021-03-25 11:14:21.296] [driver] [info] [Task Finished] Transform to mem in 0.298428s (11021 normal rows, 43162 exceptions)
[2021-03-25 11:14:21.593] [driver] [info] [Task Finished] Transform to mem in 0.297901s (11003 normal rows, 42716 exceptions)
[2021-03-25 11:14:21.891] [driver] [info] [Task Finished] Transform to mem in 0.297676s (11165 normal rows, 43260 exceptions)
[2021-03-25 11:14:22.190] [driver] [info] [Task Finished] Transform to mem in 0.298568s (11027 normal rows, 43245 exceptions)
[2021-03-25 11:14:22.488] [driver] [info] [Task Finished] Transform to mem in 0.298130s (11172 normal rows, 43107 exceptions)
[2021-03-25 11:14:22.786] [driver] [info] [Task Finished] Transform to mem in 0.297976s (10997 normal rows, 43177 exceptions)
[2021-03-25 11:14:23.084] [driver] [info] [Task Finished] Transform to mem in 0.298412s (11009 normal rows, 43050 exceptions)
[2021-03-25 11:14:23.382] [driver] [info] [Task Finished] Transform to mem in 0.297750s (10999 normal rows, 42828 exceptions)
[2021-03-25 11:14:23.680] [driver] [info] [Task Finished] Transform to mem in 0.297915s (11031 normal rows, 43157 exceptions)
[2021-03-25 11:14:23.977] [driver] [info] [Task Finished] Transform to mem in 0.296972s (11000 normal rows, 42726 exceptions)
[2021-03-25 11:14:24.275] [driver] [info] [Task Finished] Transform to mem in 0.297747s (11091 normal rows, 43230 exceptions)
[2021-03-25 11:14:24.573] [driver] [info] [Task Finished] Transform to mem in 0.298477s (11099 normal rows, 43272 exceptions)
[2021-03-25 11:14:24.872] [driver] [info] [Task Finished] Transform to mem in 0.298476s (11177 normal rows, 43113 exceptions)
[2021-03-25 11:14:25.169] [driver] [info] [Task Finished] Transform to mem in 0.297687s (10997 normal rows, 43174 exceptions)
[2021-03-25 11:14:25.468] [driver] [info] [Task Finished] Transform to mem in 0.298910s (10987 normal rows, 43020 exceptions)
[2021-03-25 11:14:25.767] [driver] [info] [Task Finished] Transform to mem in 0.298480s (11020 normal rows, 42867 exceptions)
[2021-03-25 11:14:26.100] [driver] [info] [Task Finished] Transform to mem in 0.333529s (12330 normal rows, 48094 exceptions)
[2021-03-25 11:14:26.100] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 47.6224s
[2021-03-25 11:14:26.100] [global] [info] [Transform Stage] Stage 0 total wall clock time: 47.6191s, 56350770 input rows, time to process 1 row via fast path: 0.000845048ms
[2021-03-25 11:14:26.101] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 11:14:26.105] [local ee] [info] compiled pure python pipeline in 0.004201s
[2021-03-25 11:14:26.105] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 11:14:26.106] [local ee] [info] Created 160 resolve tasks in 0.001199s
[2021-03-25 11:14:26.106] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 11:14:30.455] [driver] [info] [Task Finished] Resolve in 4.348801s
[2021-03-25 11:14:34.908] [driver] [info] [Task Finished] Resolve in 4.453100s
[2021-03-25 11:14:39.259] [driver] [info] [Task Finished] Resolve in 4.350697s
[2021-03-25 11:14:43.749] [driver] [info] [Task Finished] Resolve in 4.490564s
[2021-03-25 11:14:48.181] [driver] [info] [Task Finished] Resolve in 4.431365s
[2021-03-25 11:14:52.454] [driver] [info] [Task Finished] Resolve in 4.272781s
[2021-03-25 11:14:56.929] [driver] [info] [Task Finished] Resolve in 4.475629s
[2021-03-25 11:15:01.400] [driver] [info] [Task Finished] Resolve in 4.470369s
[2021-03-25 11:15:05.700] [driver] [info] [Task Finished] Resolve in 4.300757s
[2021-03-25 11:15:10.304] [driver] [info] [Task Finished] Resolve in 4.603992s
[2021-03-25 11:15:14.583] [driver] [info] [Task Finished] Resolve in 4.278696s
[2021-03-25 11:15:18.878] [driver] [info] [Task Finished] Resolve in 4.295237s
[2021-03-25 11:15:23.507] [driver] [info] [Task Finished] Resolve in 4.628432s
[2021-03-25 11:15:27.786] [driver] [info] [Task Finished] Resolve in 4.278694s
[2021-03-25 11:15:32.092] [driver] [info] [Task Finished] Resolve in 4.306244s
[2021-03-25 11:15:36.753] [driver] [info] [Task Finished] Resolve in 4.660754s
[2021-03-25 11:15:41.048] [driver] [info] [Task Finished] Resolve in 4.295261s
[2021-03-25 11:15:45.387] [driver] [info] [Task Finished] Resolve in 4.339276s
[2021-03-25 11:15:49.664] [driver] [info] [Task Finished] Resolve in 4.276634s
[2021-03-25 11:15:54.460] [driver] [info] [Task Finished] Resolve in 4.795757s
[2021-03-25 11:15:58.750] [driver] [info] [Task Finished] Resolve in 4.290555s
[2021-03-25 11:16:03.026] [driver] [info] [Task Finished] Resolve in 4.275789s
[2021-03-25 11:16:07.327] [driver] [info] [Task Finished] Resolve in 4.300774s
[2021-03-25 11:16:11.588] [driver] [info] [Task Finished] Resolve in 4.260685s
[2021-03-25 11:16:16.506] [driver] [info] [Task Finished] Resolve in 4.917842s
[2021-03-25 11:16:20.853] [driver] [info] [Task Finished] Resolve in 4.347799s
[2021-03-25 11:16:25.129] [driver] [info] [Task Finished] Resolve in 4.275595s
[2021-03-25 11:16:29.424] [driver] [info] [Task Finished] Resolve in 4.295305s
[2021-03-25 11:16:33.723] [driver] [info] [Task Finished] Resolve in 4.298813s
[2021-03-25 11:16:38.780] [driver] [info] [Task Finished] Resolve in 5.056498s
[2021-03-25 11:16:43.081] [driver] [info] [Task Finished] Resolve in 4.300926s
[2021-03-25 11:16:47.353] [driver] [info] [Task Finished] Resolve in 4.271777s
[2021-03-25 11:16:51.635] [driver] [info] [Task Finished] Resolve in 4.282661s
[2021-03-25 11:16:55.998] [driver] [info] [Task Finished] Resolve in 4.362311s
[2021-03-25 11:17:00.281] [driver] [info] [Task Finished] Resolve in 4.282876s
[2021-03-25 11:17:04.584] [driver] [info] [Task Finished] Resolve in 4.303309s
[2021-03-25 11:17:08.882] [driver] [info] [Task Finished] Resolve in 4.298146s
[2021-03-25 11:17:14.125] [driver] [info] [Task Finished] Resolve in 5.242576s
[2021-03-25 11:17:18.422] [driver] [info] [Task Finished] Resolve in 4.297756s
[2021-03-25 11:17:22.694] [driver] [info] [Task Finished] Resolve in 4.271483s
[2021-03-25 11:17:26.971] [driver] [info] [Task Finished] Resolve in 4.277380s
[2021-03-25 11:17:31.335] [driver] [info] [Task Finished] Resolve in 4.363946s
[2021-03-25 11:17:35.622] [driver] [info] [Task Finished] Resolve in 4.286678s
[2021-03-25 11:17:39.920] [driver] [info] [Task Finished] Resolve in 4.298396s
[2021-03-25 11:17:44.218] [driver] [info] [Task Finished] Resolve in 4.297171s
[2021-03-25 11:17:48.497] [driver] [info] [Task Finished] Resolve in 4.279226s
[2021-03-25 11:17:53.995] [driver] [info] [Task Finished] Resolve in 5.497903s
[2021-03-25 11:17:58.266] [driver] [info] [Task Finished] Resolve in 4.271067s
[2021-03-25 11:18:02.539] [driver] [info] [Task Finished] Resolve in 4.272769s
[2021-03-25 11:18:06.895] [driver] [info] [Task Finished] Resolve in 4.356546s
[2021-03-25 11:18:11.182] [driver] [info] [Task Finished] Resolve in 4.286648s
[2021-03-25 11:18:15.479] [driver] [info] [Task Finished] Resolve in 4.296486s
[2021-03-25 11:18:19.776] [driver] [info] [Task Finished] Resolve in 4.297052s
[2021-03-25 11:18:24.059] [driver] [info] [Task Finished] Resolve in 4.283456s
[2021-03-25 11:18:28.357] [driver] [info] [Task Finished] Resolve in 4.297953s
[2021-03-25 11:18:32.627] [driver] [info] [Task Finished] Resolve in 4.269468s
[2021-03-25 11:18:36.891] [driver] [info] [Task Finished] Resolve in 4.264551s
[2021-03-25 11:18:42.744] [driver] [info] [Task Finished] Resolve in 5.852312s
[2021-03-25 11:18:47.021] [driver] [info] [Task Finished] Resolve in 4.277064s
[2021-03-25 11:18:51.311] [driver] [info] [Task Finished] Resolve in 4.289945s
[2021-03-25 11:18:55.612] [driver] [info] [Task Finished] Resolve in 4.300983s
[2021-03-25 11:18:59.895] [driver] [info] [Task Finished] Resolve in 4.283720s
[2021-03-25 11:19:04.189] [driver] [info] [Task Finished] Resolve in 4.293855s
[2021-03-25 11:19:08.462] [driver] [info] [Task Finished] Resolve in 4.272882s
[2021-03-25 11:19:12.723] [driver] [info] [Task Finished] Resolve in 4.260506s
[2021-03-25 11:19:17.081] [driver] [info] [Task Finished] Resolve in 4.358468s
[2021-03-25 11:19:21.361] [driver] [info] [Task Finished] Resolve in 4.279350s
[2021-03-25 11:19:25.651] [driver] [info] [Task Finished] Resolve in 4.290139s
[2021-03-25 11:19:29.952] [driver] [info] [Task Finished] Resolve in 4.300680s
[2021-03-25 11:19:34.235] [driver] [info] [Task Finished] Resolve in 4.283843s
[2021-03-25 11:19:38.524] [driver] [info] [Task Finished] Resolve in 4.288574s
[2021-03-25 11:19:44.655] [driver] [info] [Task Finished] Resolve in 6.130580s
[2021-03-25 11:19:48.919] [driver] [info] [Task Finished] Resolve in 4.264794s
[2021-03-25 11:19:53.283] [driver] [info] [Task Finished] Resolve in 4.363512s
[2021-03-25 11:19:57.574] [driver] [info] [Task Finished] Resolve in 4.290523s
[2021-03-25 11:20:01.864] [driver] [info] [Task Finished] Resolve in 4.290060s
[2021-03-25 11:20:06.174] [driver] [info] [Task Finished] Resolve in 4.310675s
[2021-03-25 11:20:10.462] [driver] [info] [Task Finished] Resolve in 4.287718s
[2021-03-25 11:20:14.757] [driver] [info] [Task Finished] Resolve in 4.294620s
[2021-03-25 11:20:19.037] [driver] [info] [Task Finished] Resolve in 4.280544s
[2021-03-25 11:20:23.302] [driver] [info] [Task Finished] Resolve in 4.264961s
[2021-03-25 11:20:27.665] [driver] [info] [Task Finished] Resolve in 4.362540s
[2021-03-25 11:20:31.957] [driver] [info] [Task Finished] Resolve in 4.292505s
[2021-03-25 11:20:36.236] [driver] [info] [Task Finished] Resolve in 4.278897s
[2021-03-25 11:20:40.555] [driver] [info] [Task Finished] Resolve in 4.318953s
[2021-03-25 11:20:44.843] [driver] [info] [Task Finished] Resolve in 4.287826s
[2021-03-25 11:20:49.127] [driver] [info] [Task Finished] Resolve in 4.283764s
[2021-03-25 11:20:53.421] [driver] [info] [Task Finished] Resolve in 4.293674s
[2021-03-25 11:20:57.686] [driver] [info] [Task Finished] Resolve in 4.264969s
[2021-03-25 11:21:04.366] [driver] [info] [Task Finished] Resolve in 6.680401s
[2021-03-25 11:21:08.651] [driver] [info] [Task Finished] Resolve in 4.284651s
[2021-03-25 11:21:12.933] [driver] [info] [Task Finished] Resolve in 4.282245s
[2021-03-25 11:21:17.252] [driver] [info] [Task Finished] Resolve in 4.318333s
[2021-03-25 11:21:21.542] [driver] [info] [Task Finished] Resolve in 4.290438s
[2021-03-25 11:21:25.812] [driver] [info] [Task Finished] Resolve in 4.270081s
[2021-03-25 11:21:30.115] [driver] [info] [Task Finished] Resolve in 4.303350s
[2021-03-25 11:21:34.377] [driver] [info] [Task Finished] Resolve in 4.261934s
[2021-03-25 11:21:38.742] [driver] [info] [Task Finished] Resolve in 4.364054s
[2021-03-25 11:21:43.030] [driver] [info] [Task Finished] Resolve in 4.288398s
[2021-03-25 11:21:47.317] [driver] [info] [Task Finished] Resolve in 4.286708s
[2021-03-25 11:21:51.636] [driver] [info] [Task Finished] Resolve in 4.319251s
[2021-03-25 11:21:55.934] [driver] [info] [Task Finished] Resolve in 4.297593s
[2021-03-25 11:22:00.198] [driver] [info] [Task Finished] Resolve in 4.264073s
[2021-03-25 11:22:04.505] [driver] [info] [Task Finished] Resolve in 4.307178s
[2021-03-25 11:22:08.763] [driver] [info] [Task Finished] Resolve in 4.258439s
[2021-03-25 11:22:13.127] [driver] [info] [Task Finished] Resolve in 4.363385s
[2021-03-25 11:22:17.419] [driver] [info] [Task Finished] Resolve in 4.291975s
[2021-03-25 11:22:21.704] [driver] [info] [Task Finished] Resolve in 4.284949s
[2021-03-25 11:22:26.020] [driver] [info] [Task Finished] Resolve in 4.316255s
[2021-03-25 11:22:30.305] [driver] [info] [Task Finished] Resolve in 4.285010s
[2021-03-25 11:22:34.576] [driver] [info] [Task Finished] Resolve in 4.271257s
[2021-03-25 11:22:41.744] [driver] [info] [Task Finished] Resolve in 7.167854s
[2021-03-25 11:22:46.004] [driver] [info] [Task Finished] Resolve in 4.259746s
[2021-03-25 11:22:50.363] [driver] [info] [Task Finished] Resolve in 4.359004s
[2021-03-25 11:22:54.659] [driver] [info] [Task Finished] Resolve in 4.296131s
[2021-03-25 11:22:58.945] [driver] [info] [Task Finished] Resolve in 4.285246s
[2021-03-25 11:23:03.259] [driver] [info] [Task Finished] Resolve in 4.313999s
[2021-03-25 11:23:07.539] [driver] [info] [Task Finished] Resolve in 4.280732s
[2021-03-25 11:23:11.814] [driver] [info] [Task Finished] Resolve in 4.274834s
[2021-03-25 11:23:16.127] [driver] [info] [Task Finished] Resolve in 4.312934s
[2021-03-25 11:23:20.383] [driver] [info] [Task Finished] Resolve in 4.255830s
[2021-03-25 11:23:24.741] [driver] [info] [Task Finished] Resolve in 4.357869s
[2021-03-25 11:23:29.035] [driver] [info] [Task Finished] Resolve in 4.294106s
[2021-03-25 11:23:33.320] [driver] [info] [Task Finished] Resolve in 4.285030s
[2021-03-25 11:23:37.635] [driver] [info] [Task Finished] Resolve in 4.315168s
[2021-03-25 11:23:41.917] [driver] [info] [Task Finished] Resolve in 4.281995s
[2021-03-25 11:23:46.191] [driver] [info] [Task Finished] Resolve in 4.273800s
[2021-03-25 11:23:50.500] [driver] [info] [Task Finished] Resolve in 4.308644s
[2021-03-25 11:23:54.760] [driver] [info] [Task Finished] Resolve in 4.259729s
[2021-03-25 11:23:59.118] [driver] [info] [Task Finished] Resolve in 4.358729s
[2021-03-25 11:24:03.414] [driver] [info] [Task Finished] Resolve in 4.295317s
[2021-03-25 11:24:07.698] [driver] [info] [Task Finished] Resolve in 4.283954s
[2021-03-25 11:24:12.005] [driver] [info] [Task Finished] Resolve in 4.306679s
[2021-03-25 11:24:16.290] [driver] [info] [Task Finished] Resolve in 4.285589s
[2021-03-25 11:24:20.564] [driver] [info] [Task Finished] Resolve in 4.273471s
[2021-03-25 11:24:24.874] [driver] [info] [Task Finished] Resolve in 4.310351s
[2021-03-25 11:24:29.134] [driver] [info] [Task Finished] Resolve in 4.260036s
[2021-03-25 11:24:33.482] [driver] [info] [Task Finished] Resolve in 4.347426s
[2021-03-25 11:24:41.344] [driver] [info] [Task Finished] Resolve in 7.862388s
[2021-03-25 11:24:45.630] [driver] [info] [Task Finished] Resolve in 4.285579s
[2021-03-25 11:24:49.934] [driver] [info] [Task Finished] Resolve in 4.304602s
[2021-03-25 11:24:54.224] [driver] [info] [Task Finished] Resolve in 4.289758s
[2021-03-25 11:24:58.498] [driver] [info] [Task Finished] Resolve in 4.274340s
[2021-03-25 11:25:02.807] [driver] [info] [Task Finished] Resolve in 4.308083s
[2021-03-25 11:25:07.065] [driver] [info] [Task Finished] Resolve in 4.258291s
[2021-03-25 11:25:11.397] [driver] [info] [Task Finished] Resolve in 4.332228s
[2021-03-25 11:25:15.707] [driver] [info] [Task Finished] Resolve in 4.310078s
[2021-03-25 11:25:19.999] [driver] [info] [Task Finished] Resolve in 4.291543s
[2021-03-25 11:25:24.303] [driver] [info] [Task Finished] Resolve in 4.303778s
[2021-03-25 11:25:28.592] [driver] [info] [Task Finished] Resolve in 4.289704s
[2021-03-25 11:25:32.870] [driver] [info] [Task Finished] Resolve in 4.277772s
[2021-03-25 11:25:37.182] [driver] [info] [Task Finished] Resolve in 4.311920s
[2021-03-25 11:25:41.441] [driver] [info] [Task Finished] Resolve in 4.258387s
[2021-03-25 11:25:45.769] [driver] [info] [Task Finished] Resolve in 4.328138s
[2021-03-25 11:25:50.084] [driver] [info] [Task Finished] Resolve in 4.315390s
[2021-03-25 11:25:54.380] [driver] [info] [Task Finished] Resolve in 4.295376s
[2021-03-25 11:25:58.684] [driver] [info] [Task Finished] Resolve in 4.304380s
[2021-03-25 11:26:02.970] [driver] [info] [Task Finished] Resolve in 4.285990s
[2021-03-25 11:26:07.250] [driver] [info] [Task Finished] Resolve in 4.279905s
[2021-03-25 11:26:12.050] [driver] [info] [Task Finished] Resolve in 4.799910s
[2021-03-25 11:26:12.050] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 705.949s
[2021-03-25 11:26:12.050] [local ee] [info] slow path for Stage 0: total wall clock time: 705.938s, time to process 1 row via slow path: 0.10237ms
[2021-03-25 11:26:12.050] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 705.95s

[2021-03-25 11:26:12.083] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-25 11:26:12.403] [driver] [info] [Task Finished] write to file in 0.319248s (1798491 rows, 273.61 MB)
[2021-03-25 11:26:12.403] [global] [info] writing output took 0.352591s
[2021-03-25 11:26:12.403] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.352678s
[2021-03-25 11:26:12.403] [global] [info] [Transform Stage] Stage 0 took 754.424s
[2021-03-25 11:26:12.403] [global] [info] Query Execution took 754.503s. (planning: 0.0783731s, execution: 754.424s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.004935264587402344
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 754.7809588909149 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 0, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '32G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0219463,"llvm_optimization_time_s":0.331453,"llvm_compilation_time_s":0.151121,"total_compilation_time_s":0.49979,"sampling_time_s":0.111025,"stages":[{"stage_no":0,"fast_path_wall_time_s":47.6191,"fast_path_time_s":47.6224,"fast_path_per_row_time_ns":845.048,"slow_path_wall_time_s":705.938,"slow_path_time_s":705.949,"slow_path_per_row_time_ns":102370}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 0, "driverMemory": "32G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.004935264587402344, "jobTime": 754.7809588909149, "mode": "resolve", "mergeExceptionsInOrder": false}
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
