[2021-03-31 15:04:18.725] [global] [error] could not find backend, defaulting to local
[2021-03-31 15:04:18.725] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 15:04:18.725] [local ee] [info] initializing LLVM backend
[2021-03-31 15:04:18.725] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 15:04:18.725] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.726] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.726] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.726] [E/1] [info] starting detached process queue
[2021-03-31 15:04:18.726] [E/2] [info] starting detached process queue
[2021-03-31 15:04:18.726] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.726] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.726] [E/3] [info] starting detached process queue
[2021-03-31 15:04:18.726] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.726] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.726] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.726] [E/4] [info] starting detached process queue
[2021-03-31 15:04:18.726] [E/5] [info] starting detached process queue
[2021-03-31 15:04:18.726] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.726] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/6] [info] starting detached process queue
[2021-03-31 15:04:18.727] [E/7] [info] starting detached process queue
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/8] [info] starting detached process queue
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [E/9] [info] starting detached process queue
[2021-03-31 15:04:18.727] [E/10] [info] starting detached process queue
[2021-03-31 15:04:18.727] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/11] [info] starting detached process queue
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/12] [info] starting detached process queue
[2021-03-31 15:04:18.727] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [E/13] [info] starting detached process queue
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/14] [info] starting detached process queue
[2021-03-31 15:04:18.727] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 15:04:18.727] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [E/15] [info] starting detached process queue
[2021-03-31 15:04:18.727] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 15:04:18.727] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 15:04:18.727] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 15:04:18.727] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 15:04:18.728] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-31 15:04:18.863] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:04:18.870] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:04:18.885] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:04:18.894] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:04:18.921] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:04:18.941] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:04:18.955] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:04:18.987] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 15:04:18.994] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:04:19.010] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:04:19.012] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:04:19.013] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:04:19.013] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:04:19.015] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:04:19.016] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:04:19.016] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:04:19.018] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:04:19.019] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 15:04:19.020] [global] [info] performing static typing for UDF in operator map
[2021-03-31 15:04:19.036] [logical planner] [info] logical optimization took 0.022649ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 15:04:19.036] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:04:19.037] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:04:19.038] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 15:04:19.038] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 15:04:19.039] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 15:04:19.039] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 15:04:19.040] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 15:04:19.041] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 15:04:19.042] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 15:04:19.043] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 15:04:19.044] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:04:19.045] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:04:19.045] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:04:19.046] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:04:19.048] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:04:19.048] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 15:04:19.049] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 15:04:19.050] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 15:04:19.050] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 15:04:19.051] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 15:04:19.051] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 15:04:19.052] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 15:04:19.053] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 15:04:19.054] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 15:04:19.055] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:04:19.056] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 15:04:19.057] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:04:19.057] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 15:04:19.058] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 15:04:19.089] [global] [info] Stage0 depends on: 
[2021-03-31 15:04:19.438] [global] [info] Optimization via LLVM passes took 0.331094 ms
[2021-03-31 15:04:19.590] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-31 15:04:19.590] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.500931s
[2021-03-31 15:04:19.591] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-31 15:04:19.871] [E/14] [info] [Task Finished] Transform to mem in 0.280433s (11036 normal rows, 43139 exceptions)
[2021-03-31 15:04:19.871] [E/2] [info] [Task Finished] Transform to mem in 0.280551s (11047 normal rows, 43210 exceptions)
[2021-03-31 15:04:19.871] [E/1] [info] [Task Finished] Transform to mem in 0.280551s (11105 normal rows, 43095 exceptions)
[2021-03-31 15:04:19.872] [E/13] [info] [Task Finished] Transform to mem in 0.281022s (10997 normal rows, 42910 exceptions)
[2021-03-31 15:04:19.872] [E/3] [info] [Task Finished] Transform to mem in 0.281060s (11073 normal rows, 43414 exceptions)
[2021-03-31 15:04:19.872] [E/9] [info] [Task Finished] Transform to mem in 0.281133s (11092 normal rows, 43495 exceptions)
[2021-03-31 15:04:19.872] [E/15] [info] [Task Finished] Transform to mem in 0.281203s (11153 normal rows, 42968 exceptions)
[2021-03-31 15:04:19.872] [E/10] [info] [Task Finished] Transform to mem in 0.281204s (11036 normal rows, 43142 exceptions)
[2021-03-31 15:04:19.872] [E/4] [info] [Task Finished] Transform to mem in 0.281228s (11153 normal rows, 42970 exceptions)
[2021-03-31 15:04:19.872] [E/12] [info] [Task Finished] Transform to mem in 0.281296s (11005 normal rows, 42744 exceptions)
[2021-03-31 15:04:19.872] [E/11] [info] [Task Finished] Transform to mem in 0.281353s (11005 normal rows, 42741 exceptions)
[2021-03-31 15:04:19.872] [E/8] [info] [Task Finished] Transform to mem in 0.281627s (11086 normal rows, 43015 exceptions)
[2021-03-31 15:04:19.872] [E/6] [info] [Task Finished] Transform to mem in 0.281678s (11026 normal rows, 43206 exceptions)
[2021-03-31 15:04:19.872] [E/5] [info] [Task Finished] Transform to mem in 0.281741s (10997 normal rows, 42873 exceptions)
[2021-03-31 15:04:19.873] [driver] [info] [Task Finished] Transform to mem in 0.282118s (10987 normal rows, 43113 exceptions)
[2021-03-31 15:04:19.873] [E/7] [info] [Task Finished] Transform to mem in 0.282223s (11008 normal rows, 43077 exceptions)
[2021-03-31 15:04:20.149] [E/9] [info] [Task Finished] Transform to mem in 0.276950s (11023 normal rows, 42910 exceptions)
[2021-03-31 15:04:20.149] [E/5] [info] [Task Finished] Transform to mem in 0.276412s (11023 normal rows, 42880 exceptions)
[2021-03-31 15:04:20.149] [E/14] [info] [Task Finished] Transform to mem in 0.277732s (11086 normal rows, 42996 exceptions)
[2021-03-31 15:04:20.149] [E/3] [info] [Task Finished] Transform to mem in 0.277354s (10982 normal rows, 43059 exceptions)
[2021-03-31 15:04:20.149] [E/2] [info] [Task Finished] Transform to mem in 0.277877s (11092 normal rows, 43505 exceptions)
[2021-03-31 15:04:20.149] [E/8] [info] [Task Finished] Transform to mem in 0.276936s (11076 normal rows, 43220 exceptions)
[2021-03-31 15:04:20.149] [E/10] [info] [Task Finished] Transform to mem in 0.277375s (11005 normal rows, 42772 exceptions)
[2021-03-31 15:04:20.149] [E/1] [info] [Task Finished] Transform to mem in 0.278041s (11153 normal rows, 42978 exceptions)
[2021-03-31 15:04:20.149] [E/15] [info] [Task Finished] Transform to mem in 0.277558s (11036 normal rows, 43115 exceptions)
[2021-03-31 15:04:20.149] [E/4] [info] [Task Finished] Transform to mem in 0.277533s (11086 normal rows, 42970 exceptions)
[2021-03-31 15:04:20.150] [E/13] [info] [Task Finished] Transform to mem in 0.277908s (11026 normal rows, 43205 exceptions)
[2021-03-31 15:04:20.150] [E/7] [info] [Task Finished] Transform to mem in 0.276904s (10992 normal rows, 42864 exceptions)
[2021-03-31 15:04:20.150] [E/11] [info] [Task Finished] Transform to mem in 0.277865s (11111 normal rows, 42961 exceptions)
[2021-03-31 15:04:20.150] [E/6] [info] [Task Finished] Transform to mem in 0.278080s (10987 normal rows, 43068 exceptions)
[2021-03-31 15:04:20.151] [E/12] [info] [Task Finished] Transform to mem in 0.278713s (11079 normal rows, 43539 exceptions)
[2021-03-31 15:04:20.151] [driver] [info] [Task Finished] Transform to mem in 0.278581s (11036 normal rows, 43053 exceptions)
[2021-03-31 15:04:20.426] [E/1] [info] [Task Finished] Transform to mem in 0.277046s (11021 normal rows, 42887 exceptions)
[2021-03-31 15:04:20.426] [E/10] [info] [Task Finished] Transform to mem in 0.277085s (11026 normal rows, 43041 exceptions)
[2021-03-31 15:04:20.426] [E/9] [info] [Task Finished] Transform to mem in 0.277642s (11099 normal rows, 42882 exceptions)
[2021-03-31 15:04:20.426] [E/5] [info] [Task Finished] Transform to mem in 0.277609s (11063 normal rows, 43617 exceptions)
[2021-03-31 15:04:20.426] [E/2] [info] [Task Finished] Transform to mem in 0.277384s (10987 normal rows, 43063 exceptions)
[2021-03-31 15:04:20.427] [E/14] [info] [Task Finished] Transform to mem in 0.277891s (11127 normal rows, 42969 exceptions)
[2021-03-31 15:04:20.427] [E/15] [info] [Task Finished] Transform to mem in 0.277375s (11064 normal rows, 42832 exceptions)
[2021-03-31 15:04:20.427] [E/3] [info] [Task Finished] Transform to mem in 0.277770s (11076 normal rows, 43221 exceptions)
[2021-03-31 15:04:20.427] [E/8] [info] [Task Finished] Transform to mem in 0.277644s (11004 normal rows, 42876 exceptions)
[2021-03-31 15:04:20.427] [E/7] [info] [Task Finished] Transform to mem in 0.277573s (11076 normal rows, 43212 exceptions)
[2021-03-31 15:04:20.427] [E/11] [info] [Task Finished] Transform to mem in 0.277618s (10987 normal rows, 43041 exceptions)
[2021-03-31 15:04:20.428] [E/13] [info] [Task Finished] Transform to mem in 0.278000s (11127 normal rows, 43028 exceptions)
[2021-03-31 15:04:20.428] [E/4] [info] [Task Finished] Transform to mem in 0.278218s (11098 normal rows, 43603 exceptions)
[2021-03-31 15:04:20.428] [E/6] [info] [Task Finished] Transform to mem in 0.278016s (11004 normal rows, 42913 exceptions)
[2021-03-31 15:04:20.429] [E/12] [info] [Task Finished] Transform to mem in 0.278469s (11026 normal rows, 43037 exceptions)
[2021-03-31 15:04:20.429] [driver] [info] [Task Finished] Transform to mem in 0.277906s (11012 normal rows, 42883 exceptions)
[2021-03-31 15:04:20.707] [E/1] [info] [Task Finished] Transform to mem in 0.281023s (11073 normal rows, 42820 exceptions)
[2021-03-31 15:04:20.708] [E/5] [info] [Task Finished] Transform to mem in 0.281278s (11076 normal rows, 43152 exceptions)
[2021-03-31 15:04:20.708] [E/8] [info] [Task Finished] Transform to mem in 0.281038s (11073 normal rows, 42754 exceptions)
[2021-03-31 15:04:20.708] [E/2] [info] [Task Finished] Transform to mem in 0.281686s (10976 normal rows, 43110 exceptions)
[2021-03-31 15:04:20.708] [E/3] [info] [Task Finished] Transform to mem in 0.281409s (11012 normal rows, 42888 exceptions)
[2021-03-31 15:04:20.708] [E/15] [info] [Task Finished] Transform to mem in 0.281627s (11026 normal rows, 43035 exceptions)
[2021-03-31 15:04:20.709] [E/9] [info] [Task Finished] Transform to mem in 0.282235s (11130 normal rows, 43084 exceptions)
[2021-03-31 15:04:20.709] [E/10] [info] [Task Finished] Transform to mem in 0.282349s (11095 normal rows, 43503 exceptions)
[2021-03-31 15:04:20.709] [E/7] [info] [Task Finished] Transform to mem in 0.281895s (11095 normal rows, 43552 exceptions)
[2021-03-31 15:04:20.709] [E/14] [info] [Task Finished] Transform to mem in 0.282618s (11015 normal rows, 42966 exceptions)
[2021-03-31 15:04:20.710] [E/4] [info] [Task Finished] Transform to mem in 0.281985s (10974 normal rows, 43172 exceptions)
[2021-03-31 15:04:20.710] [E/13] [info] [Task Finished] Transform to mem in 0.282209s (11069 normal rows, 43142 exceptions)
[2021-03-31 15:04:20.710] [E/11] [info] [Task Finished] Transform to mem in 0.282515s (11130 normal rows, 43033 exceptions)
[2021-03-31 15:04:20.711] [E/6] [info] [Task Finished] Transform to mem in 0.282305s (11008 normal rows, 42964 exceptions)
[2021-03-31 15:04:20.711] [driver] [info] [Task Finished] Transform to mem in 0.281744s (11012 normal rows, 42911 exceptions)
[2021-03-31 15:04:20.711] [E/12] [info] [Task Finished] Transform to mem in 0.282234s (11042 normal rows, 43023 exceptions)
[2021-03-31 15:04:20.984] [E/1] [info] [Task Finished] Transform to mem in 0.277038s (11063 normal rows, 42726 exceptions)
[2021-03-31 15:04:20.985] [E/5] [info] [Task Finished] Transform to mem in 0.277043s (11105 normal rows, 43555 exceptions)
[2021-03-31 15:04:20.986] [E/3] [info] [Task Finished] Transform to mem in 0.277410s (11005 normal rows, 43164 exceptions)
[2021-03-31 15:04:20.986] [E/15] [info] [Task Finished] Transform to mem in 0.277274s (11008 normal rows, 42975 exceptions)
[2021-03-31 15:04:20.986] [E/2] [info] [Task Finished] Transform to mem in 0.277699s (11087 normal rows, 43150 exceptions)
[2021-03-31 15:04:20.986] [E/8] [info] [Task Finished] Transform to mem in 0.278012s (11081 normal rows, 43050 exceptions)
[2021-03-31 15:04:20.986] [E/10] [info] [Task Finished] Transform to mem in 0.277252s (11002 normal rows, 42964 exceptions)
[2021-03-31 15:04:20.986] [E/9] [info] [Task Finished] Transform to mem in 0.277646s (11042 normal rows, 42959 exceptions)
[2021-03-31 15:04:20.987] [E/7] [info] [Task Finished] Transform to mem in 0.277672s (11073 normal rows, 42720 exceptions)
[2021-03-31 15:04:20.988] [E/11] [info] [Task Finished] Transform to mem in 0.277693s (11005 normal rows, 43229 exceptions)
[2021-03-31 15:04:20.988] [E/13] [info] [Task Finished] Transform to mem in 0.277936s (11087 normal rows, 43044 exceptions)
[2021-03-31 15:04:20.988] [E/4] [info] [Task Finished] Transform to mem in 0.278187s (11098 normal rows, 43112 exceptions)
[2021-03-31 15:04:20.988] [driver] [info] [Task Finished] Transform to mem in 0.276916s (11024 normal rows, 42947 exceptions)
[2021-03-31 15:04:20.988] [E/14] [info] [Task Finished] Transform to mem in 0.278574s (11088 normal rows, 43511 exceptions)
[2021-03-31 15:04:20.989] [E/6] [info] [Task Finished] Transform to mem in 0.278742s (11008 normal rows, 43017 exceptions)
[2021-03-31 15:04:20.990] [E/12] [info] [Task Finished] Transform to mem in 0.278117s (11020 normal rows, 42976 exceptions)
[2021-03-31 15:04:21.261] [E/1] [info] [Task Finished] Transform to mem in 0.276276s (11036 normal rows, 42710 exceptions)
[2021-03-31 15:04:21.262] [E/5] [info] [Task Finished] Transform to mem in 0.277198s (11125 normal rows, 43517 exceptions)
[2021-03-31 15:04:21.263] [E/15] [info] [Task Finished] Transform to mem in 0.277241s (11087 normal rows, 42938 exceptions)
[2021-03-31 15:04:21.263] [E/10] [info] [Task Finished] Transform to mem in 0.277449s (11052 normal rows, 42881 exceptions)
[2021-03-31 15:04:21.264] [E/2] [info] [Task Finished] Transform to mem in 0.278008s (10985 normal rows, 43336 exceptions)
[2021-03-31 15:04:21.264] [E/3] [info] [Task Finished] Transform to mem in 0.278367s (11098 normal rows, 43115 exceptions)
[2021-03-31 15:04:21.264] [E/7] [info] [Task Finished] Transform to mem in 0.277169s (10995 normal rows, 42708 exceptions)
[2021-03-31 15:04:21.264] [E/9] [info] [Task Finished] Transform to mem in 0.277879s (11020 normal rows, 43057 exceptions)
[2021-03-31 15:04:21.264] [E/8] [info] [Task Finished] Transform to mem in 0.278326s (11000 normal rows, 42999 exceptions)
[2021-03-31 15:04:21.265] [driver] [info] [Task Finished] Transform to mem in 0.276998s (10999 normal rows, 43334 exceptions)
[2021-03-31 15:04:21.265] [E/4] [info] [Task Finished] Transform to mem in 0.277556s (11073 normal rows, 42970 exceptions)
[2021-03-31 15:04:21.266] [E/13] [info] [Task Finished] Transform to mem in 0.278196s (11098 normal rows, 43075 exceptions)
[2021-03-31 15:04:21.266] [E/11] [info] [Task Finished] Transform to mem in 0.278692s (11166 normal rows, 43520 exceptions)
[2021-03-31 15:04:21.267] [E/14] [info] [Task Finished] Transform to mem in 0.278617s (11000 normal rows, 43009 exceptions)
[2021-03-31 15:04:21.267] [E/6] [info] [Task Finished] Transform to mem in 0.277880s (11052 normal rows, 42764 exceptions)
[2021-03-31 15:04:21.268] [E/12] [info] [Task Finished] Transform to mem in 0.278585s (11020 normal rows, 43138 exceptions)
[2021-03-31 15:04:21.538] [E/1] [info] [Task Finished] Transform to mem in 0.276903s (10995 normal rows, 42726 exceptions)
[2021-03-31 15:04:21.539] [E/5] [info] [Task Finished] Transform to mem in 0.277462s (11166 normal rows, 43508 exceptions)
[2021-03-31 15:04:21.540] [E/15] [info] [Task Finished] Transform to mem in 0.277115s (11091 normal rows, 43047 exceptions)
[2021-03-31 15:04:21.541] [E/10] [info] [Task Finished] Transform to mem in 0.277405s (11080 normal rows, 43031 exceptions)
[2021-03-31 15:04:21.541] [E/2] [info] [Task Finished] Transform to mem in 0.277381s (10999 normal rows, 43300 exceptions)
[2021-03-31 15:04:21.542] [E/9] [info] [Task Finished] Transform to mem in 0.277570s (11016 normal rows, 43165 exceptions)
[2021-03-31 15:04:21.542] [E/7] [info] [Task Finished] Transform to mem in 0.277687s (11036 normal rows, 42720 exceptions)
[2021-03-31 15:04:21.542] [E/3] [info] [Task Finished] Transform to mem in 0.277920s (11000 normal rows, 43043 exceptions)
[2021-03-31 15:04:21.542] [E/8] [info] [Task Finished] Transform to mem in 0.277724s (10995 normal rows, 42718 exceptions)
[2021-03-31 15:04:21.543] [E/4] [info] [Task Finished] Transform to mem in 0.277182s (11001 normal rows, 43113 exceptions)
[2021-03-31 15:04:21.543] [driver] [info] [Task Finished] Transform to mem in 0.278114s (11186 normal rows, 43465 exceptions)
[2021-03-31 15:04:21.543] [E/13] [info] [Task Finished] Transform to mem in 0.277494s (11170 normal rows, 43024 exceptions)
[2021-03-31 15:04:21.544] [E/11] [info] [Task Finished] Transform to mem in 0.277812s (10989 normal rows, 43282 exceptions)
[2021-03-31 15:04:21.545] [E/6] [info] [Task Finished] Transform to mem in 0.277369s (11002 normal rows, 42755 exceptions)
[2021-03-31 15:04:21.545] [E/14] [info] [Task Finished] Transform to mem in 0.278379s (11010 normal rows, 43002 exceptions)
[2021-03-31 15:04:21.547] [E/12] [info] [Task Finished] Transform to mem in 0.278468s (11050 normal rows, 43199 exceptions)
[2021-03-31 15:04:21.814] [E/1] [info] [Task Finished] Transform to mem in 0.276405s (10973 normal rows, 42686 exceptions)
[2021-03-31 15:04:21.817] [E/5] [info] [Task Finished] Transform to mem in 0.277358s (11160 normal rows, 43455 exceptions)
[2021-03-31 15:04:21.818] [E/10] [info] [Task Finished] Transform to mem in 0.277243s (11166 normal rows, 43023 exceptions)
[2021-03-31 15:04:21.818] [E/2] [info] [Task Finished] Transform to mem in 0.277070s (10997 normal rows, 43283 exceptions)
[2021-03-31 15:04:21.819] [E/15] [info] [Task Finished] Transform to mem in 0.278432s (11045 normal rows, 43148 exceptions)
[2021-03-31 15:04:21.819] [E/9] [info] [Task Finished] Transform to mem in 0.276824s (11005 normal rows, 42971 exceptions)
[2021-03-31 15:04:21.819] [E/7] [info] [Task Finished] Transform to mem in 0.277292s (11007 normal rows, 42795 exceptions)
[2021-03-31 15:04:21.819] [E/8] [info] [Task Finished] Transform to mem in 0.277267s (10973 normal rows, 42686 exceptions)
[2021-03-31 15:04:21.820] [driver] [info] [Task Finished] Transform to mem in 0.276839s (11043 normal rows, 43153 exceptions)
[2021-03-31 15:04:21.820] [E/4] [info] [Task Finished] Transform to mem in 0.277418s (11160 normal rows, 43446 exceptions)
[2021-03-31 15:04:21.820] [E/3] [info] [Task Finished] Transform to mem in 0.278156s (11050 normal rows, 43196 exceptions)
[2021-03-31 15:04:21.821] [E/13] [info] [Task Finished] Transform to mem in 0.278000s (11168 normal rows, 43028 exceptions)
[2021-03-31 15:04:21.822] [E/6] [info] [Task Finished] Transform to mem in 0.277261s (10997 normal rows, 42973 exceptions)
[2021-03-31 15:04:21.822] [E/11] [info] [Task Finished] Transform to mem in 0.278086s (10997 normal rows, 43277 exceptions)
[2021-03-31 15:04:21.823] [E/14] [info] [Task Finished] Transform to mem in 0.277764s (11015 normal rows, 42799 exceptions)
[2021-03-31 15:04:21.825] [E/12] [info] [Task Finished] Transform to mem in 0.278220s (11050 normal rows, 43170 exceptions)
[2021-03-31 15:04:22.095] [E/1] [info] [Task Finished] Transform to mem in 0.281219s (10973 normal rows, 42710 exceptions)
[2021-03-31 15:04:22.098] [E/5] [info] [Task Finished] Transform to mem in 0.280836s (11160 normal rows, 43431 exceptions)
[2021-03-31 15:04:22.099] [E/10] [info] [Task Finished] Transform to mem in 0.280501s (11043 normal rows, 43166 exceptions)
[2021-03-31 15:04:22.099] [E/15] [info] [Task Finished] Transform to mem in 0.280168s (10997 normal rows, 43237 exceptions)
[2021-03-31 15:04:22.099] [E/9] [info] [Task Finished] Transform to mem in 0.280676s (10997 normal rows, 43012 exceptions)
[2021-03-31 15:04:22.100] [E/2] [info] [Task Finished] Transform to mem in 0.281117s (11168 normal rows, 43027 exceptions)
[2021-03-31 15:04:22.100] [driver] [info] [Task Finished] Transform to mem in 0.280080s (11003 normal rows, 42716 exceptions)
[2021-03-31 15:04:22.100] [E/7] [info] [Task Finished] Transform to mem in 0.281045s (11009 normal rows, 42805 exceptions)
[2021-03-31 15:04:22.100] [E/4] [info] [Task Finished] Transform to mem in 0.280361s (11165 normal rows, 43354 exceptions)
[2021-03-31 15:04:22.100] [E/8] [info] [Task Finished] Transform to mem in 0.281119s (11021 normal rows, 43160 exceptions)
[2021-03-31 15:04:22.102] [E/3] [info] [Task Finished] Transform to mem in 0.281968s (11043 normal rows, 43217 exceptions)
[2021-03-31 15:04:22.102] [E/6] [info] [Task Finished] Transform to mem in 0.280258s (11009 normal rows, 43187 exceptions)
[2021-03-31 15:04:22.103] [E/13] [info] [Task Finished] Transform to mem in 0.281410s (11156 normal rows, 43044 exceptions)
[2021-03-31 15:04:22.104] [E/11] [info] [Task Finished] Transform to mem in 0.281285s (10997 normal rows, 43067 exceptions)
[2021-03-31 15:04:22.104] [E/14] [info] [Task Finished] Transform to mem in 0.280943s (11009 normal rows, 42811 exceptions)
[2021-03-31 15:04:22.106] [E/12] [info] [Task Finished] Transform to mem in 0.281186s (11021 normal rows, 43162 exceptions)
[2021-03-31 15:04:22.372] [E/1] [info] [Task Finished] Transform to mem in 0.276209s (11003 normal rows, 42716 exceptions)
[2021-03-31 15:04:22.375] [E/5] [info] [Task Finished] Transform to mem in 0.277076s (11165 normal rows, 43260 exceptions)
[2021-03-31 15:04:22.376] [E/10] [info] [Task Finished] Transform to mem in 0.277459s (11027 normal rows, 43245 exceptions)
[2021-03-31 15:04:22.377] [E/9] [info] [Task Finished] Transform to mem in 0.277384s (10997 normal rows, 43177 exceptions)
[2021-03-31 15:04:22.377] [driver] [info] [Task Finished] Transform to mem in 0.277053s (10999 normal rows, 42828 exceptions)
[2021-03-31 15:04:22.377] [E/2] [info] [Task Finished] Transform to mem in 0.277608s (11009 normal rows, 43050 exceptions)
[2021-03-31 15:04:22.377] [E/4] [info] [Task Finished] Transform to mem in 0.276842s (11000 normal rows, 42726 exceptions)
[2021-03-31 15:04:22.378] [E/7] [info] [Task Finished] Transform to mem in 0.277878s (11031 normal rows, 43157 exceptions)
[2021-03-31 15:04:22.379] [E/8] [info] [Task Finished] Transform to mem in 0.278188s (11091 normal rows, 43230 exceptions)
[2021-03-31 15:04:22.380] [E/6] [info] [Task Finished] Transform to mem in 0.277392s (11177 normal rows, 43113 exceptions)
[2021-03-31 15:04:22.380] [E/13] [info] [Task Finished] Transform to mem in 0.277494s (10997 normal rows, 43174 exceptions)
[2021-03-31 15:04:22.381] [E/3] [info] [Task Finished] Transform to mem in 0.278380s (11099 normal rows, 43272 exceptions)
[2021-03-31 15:04:22.381] [E/11] [info] [Task Finished] Transform to mem in 0.277628s (10987 normal rows, 43020 exceptions)
[2021-03-31 15:04:22.382] [E/14] [info] [Task Finished] Transform to mem in 0.278053s (11020 normal rows, 42867 exceptions)
[2021-03-31 15:04:22.407] [E/15] [info] [Task Finished] Transform to mem in 0.308058s (11172 normal rows, 43107 exceptions)
[2021-03-31 15:04:22.416] [E/12] [info] [Task Finished] Transform to mem in 0.310413s (12330 normal rows, 48094 exceptions)
[2021-03-31 15:04:22.417] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.82627s
[2021-03-31 15:04:22.417] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.6622s, 56350770 input rows, time to process 1 row via fast path: 0.000792575ms
[2021-03-31 15:04:22.417] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-31 15:04:22.421] [local ee] [info] compiled pure python pipeline in 0.004261s
[2021-03-31 15:04:22.421] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 15:04:22.422] [local ee] [info] Created 160 resolve tasks in 0.001292s
[2021-03-31 15:04:22.422] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 15:05:19.556] [E/14] [info] [Task Finished] Resolve in 57.133398s
[2021-03-31 15:05:28.223] [E/8] [info] [Task Finished] Resolve in 65.800599s
[2021-03-31 15:05:34.246] [E/2] [info] [Task Finished] Resolve in 71.823802s
[2021-03-31 15:05:35.939] [E/5] [info] [Task Finished] Resolve in 73.516730s
[2021-03-31 15:05:36.207] [E/9] [info] [Task Finished] Resolve in 73.785066s
[2021-03-31 15:05:37.832] [E/15] [info] [Task Finished] Resolve in 75.409762s
[2021-03-31 15:05:38.288] [driver] [info] [Task Finished] Resolve in 75.865625s
[2021-03-31 15:05:39.609] [E/6] [info] [Task Finished] Resolve in 77.186885s
[2021-03-31 15:05:39.786] [E/13] [info] [Task Finished] Resolve in 77.364076s
[2021-03-31 15:05:40.977] [E/1] [info] [Task Finished] Resolve in 78.554390s
[2021-03-31 15:05:44.958] [E/4] [info] [Task Finished] Resolve in 82.535517s
[2021-03-31 15:05:45.382] [E/7] [info] [Task Finished] Resolve in 82.959770s
[2021-03-31 15:05:47.061] [E/3] [info] [Task Finished] Resolve in 84.638595s
[2021-03-31 15:05:47.564] [E/10] [info] [Task Finished] Resolve in 85.141364s
[2021-03-31 15:05:54.982] [E/12] [info] [Task Finished] Resolve in 92.559727s
[2021-03-31 15:05:57.014] [E/11] [info] [Task Finished] Resolve in 94.591735s
[2021-03-31 15:06:27.148] [E/8] [info] [Task Finished] Resolve in 58.924802s
[2021-03-31 15:06:43.406] [E/5] [info] [Task Finished] Resolve in 67.467426s
[2021-03-31 15:06:43.881] [E/14] [info] [Task Finished] Resolve in 84.325163s
[2021-03-31 15:06:48.820] [E/3] [info] [Task Finished] Resolve in 61.759100s
[2021-03-31 15:06:52.709] [E/2] [info] [Task Finished] Resolve in 78.463206s
[2021-03-31 15:06:53.261] [E/9] [info] [Task Finished] Resolve in 77.053851s
[2021-03-31 15:06:54.499] [E/10] [info] [Task Finished] Resolve in 66.934959s
[2021-03-31 15:06:55.853] [E/6] [info] [Task Finished] Resolve in 76.243817s
[2021-03-31 15:06:57.973] [driver] [info] [Task Finished] Resolve in 79.684982s
[2021-03-31 15:07:00.314] [E/12] [info] [Task Finished] Resolve in 65.332005s
[2021-03-31 15:07:02.946] [E/13] [info] [Task Finished] Resolve in 83.159123s
[2021-03-31 15:07:04.048] [E/4] [info] [Task Finished] Resolve in 79.090413s
[2021-03-31 15:07:05.294] [E/7] [info] [Task Finished] Resolve in 79.912242s
[2021-03-31 15:07:09.076] [E/15] [info] [Task Finished] Resolve in 91.243828s
[2021-03-31 15:07:11.620] [E/1] [info] [Task Finished] Resolve in 90.642853s
[2021-03-31 15:07:18.101] [E/11] [info] [Task Finished] Resolve in 81.086470s
[2021-03-31 15:07:23.667] [E/8] [info] [Task Finished] Resolve in 56.519639s
[2021-03-31 15:07:57.490] [E/5] [info] [Task Finished] Resolve in 74.083554s
[2021-03-31 15:08:01.169] [E/9] [info] [Task Finished] Resolve in 67.907376s
[2021-03-31 15:08:07.323] [E/14] [info] [Task Finished] Resolve in 83.442012s
[2021-03-31 15:08:12.277] [E/2] [info] [Task Finished] Resolve in 79.567403s
[2021-03-31 15:08:14.177] [E/10] [info] [Task Finished] Resolve in 79.678726s
[2021-03-31 15:08:15.482] [E/6] [info] [Task Finished] Resolve in 79.628618s
[2021-03-31 15:08:16.481] [E/12] [info] [Task Finished] Resolve in 76.166672s
[2021-03-31 15:08:17.804] [E/4] [info] [Task Finished] Resolve in 73.756012s
[2021-03-31 15:08:18.358] [E/13] [info] [Task Finished] Resolve in 75.412661s
[2021-03-31 15:08:19.167] [E/7] [info] [Task Finished] Resolve in 73.872431s
[2021-03-31 15:08:19.383] [E/3] [info] [Task Finished] Resolve in 90.562916s
[2021-03-31 15:08:26.935] [driver] [info] [Task Finished] Resolve in 88.962209s
[2021-03-31 15:08:27.167] [E/1] [info] [Task Finished] Resolve in 75.546967s
[2021-03-31 15:08:28.175] [E/15] [info] [Task Finished] Resolve in 79.098577s
[2021-03-31 15:08:30.458] [E/8] [info] [Task Finished] Resolve in 66.791055s
[2021-03-31 15:08:42.436] [E/11] [info] [Task Finished] Resolve in 84.335107s
[2021-03-31 15:09:18.268] [E/2] [info] [Task Finished] Resolve in 65.990970s
[2021-03-31 15:09:19.065] [E/9] [info] [Task Finished] Resolve in 77.896393s
[2021-03-31 15:09:21.207] [E/14] [info] [Task Finished] Resolve in 73.884204s
[2021-03-31 15:09:21.865] [E/5] [info] [Task Finished] Resolve in 84.375294s
[2021-03-31 15:09:29.269] [E/12] [info] [Task Finished] Resolve in 72.788614s
[2021-03-31 15:09:31.569] [E/4] [info] [Task Finished] Resolve in 73.764421s
[2021-03-31 15:09:33.393] [E/15] [info] [Task Finished] Resolve in 65.218207s
[2021-03-31 15:09:35.467] [E/3] [info] [Task Finished] Resolve in 76.083964s
[2021-03-31 15:09:37.238] [E/13] [info] [Task Finished] Resolve in 78.879735s
[2021-03-31 15:09:37.581] [E/6] [info] [Task Finished] Resolve in 82.098886s
[2021-03-31 15:09:39.373] [E/10] [info] [Task Finished] Resolve in 85.195685s
[2021-03-31 15:09:42.318] [E/1] [info] [Task Finished] Resolve in 75.151687s
[2021-03-31 15:09:45.290] [E/7] [info] [Task Finished] Resolve in 86.122693s
[2021-03-31 15:09:45.592] [E/8] [info] [Task Finished] Resolve in 75.133964s
[2021-03-31 15:09:53.094] [driver] [info] [Task Finished] Resolve in 86.158600s
[2021-03-31 15:09:57.055] [E/11] [info] [Task Finished] Resolve in 74.619374s
[2021-03-31 15:10:26.951] [E/9] [info] [Task Finished] Resolve in 67.885482s
[2021-03-31 15:10:33.249] [E/12] [info] [Task Finished] Resolve in 63.979067s
[2021-03-31 15:10:33.354] [E/3] [info] [Task Finished] Resolve in 57.887087s
[2021-03-31 15:10:37.033] [E/13] [info] [Task Finished] Resolve in 59.795493s
[2021-03-31 15:10:40.396] [E/14] [info] [Task Finished] Resolve in 79.188657s
[2021-03-31 15:10:47.442] [E/8] [info] [Task Finished] Resolve in 61.849116s
[2021-03-31 15:10:47.716] [E/2] [info] [Task Finished] Resolve in 89.448618s
[2021-03-31 15:10:50.429] [E/15] [info] [Task Finished] Resolve in 77.035722s
[2021-03-31 15:10:52.046] [E/5] [info] [Task Finished] Resolve in 90.180821s
[2021-03-31 15:10:56.188] [E/4] [info] [Task Finished] Resolve in 84.618906s
[2021-03-31 15:11:01.275] [E/10] [info] [Task Finished] Resolve in 81.902304s
[2021-03-31 15:11:05.529] [E/7] [info] [Task Finished] Resolve in 80.239563s
[2021-03-31 15:11:06.034] [E/1] [info] [Task Finished] Resolve in 83.715895s
[2021-03-31 15:11:07.544] [E/6] [info] [Task Finished] Resolve in 89.963827s
[2021-03-31 15:11:18.384] [driver] [info] [Task Finished] Resolve in 85.289772s
[2021-03-31 15:11:19.961] [E/11] [info] [Task Finished] Resolve in 82.905789s
[2021-03-31 15:11:48.472] [E/9] [info] [Task Finished] Resolve in 81.521603s
[2021-03-31 15:11:55.072] [E/12] [info] [Task Finished] Resolve in 81.823181s
[2021-03-31 15:11:56.397] [E/3] [info] [Task Finished] Resolve in 83.042712s
[2021-03-31 15:12:00.090] [E/13] [info] [Task Finished] Resolve in 83.056788s
[2021-03-31 15:12:00.473] [E/14] [info] [Task Finished] Resolve in 80.077345s
[2021-03-31 15:12:02.320] [E/15] [info] [Task Finished] Resolve in 71.890638s
[2021-03-31 15:12:03.183] [E/8] [info] [Task Finished] Resolve in 75.741309s
[2021-03-31 15:12:08.951] [E/4] [info] [Task Finished] Resolve in 72.763754s
[2021-03-31 15:12:09.312] [E/2] [info] [Task Finished] Resolve in 81.595100s
[2021-03-31 15:12:12.620] [E/5] [info] [Task Finished] Resolve in 80.573754s
[2021-03-31 15:12:12.839] [E/10] [info] [Task Finished] Resolve in 71.563713s
[2021-03-31 15:12:25.941] [E/1] [info] [Task Finished] Resolve in 79.906616s
[2021-03-31 15:12:28.828] [driver] [info] [Task Finished] Resolve in 70.444840s
[2021-03-31 15:12:31.836] [E/7] [info] [Task Finished] Resolve in 86.307334s
[2021-03-31 15:12:34.843] [E/6] [info] [Task Finished] Resolve in 87.298039s
[2021-03-31 15:12:37.288] [E/11] [info] [Task Finished] Resolve in 77.326717s
[2021-03-31 15:12:53.087] [E/9] [info] [Task Finished] Resolve in 64.614453s
[2021-03-31 15:12:59.952] [E/3] [info] [Task Finished] Resolve in 63.555023s
[2021-03-31 15:13:10.313] [E/13] [info] [Task Finished] Resolve in 70.222174s
[2021-03-31 15:13:10.589] [E/12] [info] [Task Finished] Resolve in 75.517090s
[2021-03-31 15:13:11.438] [E/8] [info] [Task Finished] Resolve in 68.254946s
[2021-03-31 15:13:22.343] [E/4] [info] [Task Finished] Resolve in 73.391828s
[2021-03-31 15:13:22.456] [E/14] [info] [Task Finished] Resolve in 81.982519s
[2021-03-31 15:13:26.191] [E/15] [info] [Task Finished] Resolve in 83.871177s
[2021-03-31 15:13:32.160] [E/10] [info] [Task Finished] Resolve in 79.320694s
[2021-03-31 15:13:34.745] [E/5] [info] [Task Finished] Resolve in 82.125184s
[2021-03-31 15:13:39.193] [E/2] [info] [Task Finished] Resolve in 89.881510s
[2021-03-31 15:13:39.927] [driver] [info] [Task Finished] Resolve in 71.098224s
[2021-03-31 15:13:46.550] [E/7] [info] [Task Finished] Resolve in 74.713459s
[2021-03-31 15:13:47.853] [E/1] [info] [Task Finished] Resolve in 81.911933s
[2021-03-31 15:13:57.745] [E/6] [info] [Task Finished] Resolve in 82.902727s
[2021-03-31 15:14:03.512] [E/9] [info] [Task Finished] Resolve in 70.425332s
[2021-03-31 15:14:05.948] [E/11] [info] [Task Finished] Resolve in 88.660237s
[2021-03-31 15:14:17.358] [E/8] [info] [Task Finished] Resolve in 65.920456s
[2021-03-31 15:14:20.964] [E/3] [info] [Task Finished] Resolve in 81.012251s
[2021-03-31 15:14:30.421] [E/12] [info] [Task Finished] Resolve in 79.832593s
[2021-03-31 15:14:34.500] [E/4] [info] [Task Finished] Resolve in 72.156813s
[2021-03-31 15:14:36.096] [E/13] [info] [Task Finished] Resolve in 85.783808s
[2021-03-31 15:14:37.591] [E/14] [info] [Task Finished] Resolve in 75.134997s
[2021-03-31 15:14:37.700] [E/10] [info] [Task Finished] Resolve in 65.539782s
[2021-03-31 15:14:45.812] [E/15] [info] [Task Finished] Resolve in 79.621581s
[2021-03-31 15:14:57.532] [E/5] [info] [Task Finished] Resolve in 82.786942s
[2021-03-31 15:14:58.702] [E/1] [info] [Task Finished] Resolve in 70.848835s
[2021-03-31 15:14:58.704] [driver] [info] [Task Finished] Resolve in 78.777149s
[2021-03-31 15:15:02.543] [E/7] [info] [Task Finished] Resolve in 75.992511s
[2021-03-31 15:15:05.945] [E/2] [info] [Task Finished] Resolve in 86.751615s
[2021-03-31 15:15:15.480] [E/9] [info] [Task Finished] Resolve in 71.967675s
[2021-03-31 15:15:21.482] [E/11] [info] [Task Finished] Resolve in 75.534005s
[2021-03-31 15:15:22.115] [E/6] [info] [Task Finished] Resolve in 84.369602s
[2021-03-31 15:15:23.539] [E/8] [info] [Task Finished] Resolve in 66.180573s
[2021-03-31 15:15:31.216] [E/3] [info] [Task Finished] Resolve in 70.251501s
[2021-03-31 15:15:36.276] [E/12] [info] [Task Finished] Resolve in 65.854597s
[2021-03-31 15:15:48.846] [E/10] [info] [Task Finished] Resolve in 71.145888s
[2021-03-31 15:15:56.273] [E/13] [info] [Task Finished] Resolve in 80.176691s
[2021-03-31 15:15:58.160] [E/4] [info] [Task Finished] Resolve in 83.660057s
[2021-03-31 15:16:00.167] [E/14] [info] [Task Finished] Resolve in 82.576041s
[2021-03-31 15:16:03.221] [driver] [info] [Task Finished] Resolve in 64.516896s
[2021-03-31 15:16:10.692] [E/1] [info] [Task Finished] Resolve in 71.990672s
[2021-03-31 15:16:20.390] [E/9] [info] [Task Finished] Resolve in 64.909743s
[2021-03-31 15:16:23.601] [E/6] [info] [Task Finished] Resolve in 61.486061s
[2021-03-31 15:16:24.245] [E/15] [info] [Task Finished] Resolve in 98.432395s
[2021-03-31 15:16:25.463] [E/5] [info] [Task Finished] Resolve in 87.931213s
[2021-03-31 15:16:28.617] [E/7] [info] [Task Finished] Resolve in 86.074853s
[2021-03-31 15:16:30.418] [E/2] [info] [Task Finished] Resolve in 84.472819s
[2021-03-31 15:16:37.321] [E/11] [info] [Task Finished] Resolve in 75.838615s
[2021-03-31 15:16:42.599] [E/12] [info] [Task Finished] Resolve in 66.322645s
[2021-03-31 15:16:42.644] [E/3] [info] [Task Finished] Resolve in 71.428728s
[2021-03-31 15:16:49.595] [E/8] [info] [Task Finished] Resolve in 86.056301s
[2021-03-31 15:16:55.820] [E/10] [info] [Task Finished] Resolve in 66.974742s
[2021-03-31 15:17:00.838] [E/13] [info] [Task Finished] Resolve in 64.564642s
[2021-03-31 15:17:02.495] [E/14] [info] [Task Finished] Resolve in 62.328213s
[2021-03-31 15:17:05.474] [E/4] [info] [Task Finished] Resolve in 67.313970s
[2021-03-31 15:17:07.745] [E/1] [info] [Task Finished] Resolve in 57.052697s
[2021-03-31 15:17:09.613] [driver] [info] [Task Finished] Resolve in 66.392161s
[2021-03-31 15:17:12.473] [E/9] [info] [Task Finished] Resolve in 52.083615s
[2021-03-31 15:17:12.646] [E/7] [info] [Task Finished] Resolve in 44.028383s
[2021-03-31 15:17:13.753] [E/15] [info] [Task Finished] Resolve in 49.508083s
[2021-03-31 15:17:13.888] [E/5] [info] [Task Finished] Resolve in 48.424379s
[2021-03-31 15:17:13.943] [E/6] [info] [Task Finished] Resolve in 50.341507s
[2021-03-31 15:17:13.943] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 771.526s
[2021-03-31 15:17:13.943] [local ee] [info] slow path for Stage 0: total wall clock time: 12112.5s, time to process 1 row via slow path: 1.75647ms
[2021-03-31 15:17:13.943] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 771.526s

[2021-03-31 15:17:13.971] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-31 15:17:13.985] [E/12] [info] [Task Finished] write to file in 0.014249s (46082 rows, 7.01 MB)
[2021-03-31 15:17:14.004] [E/15] [info] [Task Finished] write to file in 0.032462s (112583 rows, 17.13 MB)
[2021-03-31 15:17:14.004] [E/13] [info] [Task Finished] write to file in 0.032693s (112438 rows, 17.10 MB)
[2021-03-31 15:17:14.004] [E/11] [info] [Task Finished] write to file in 0.032735s (112425 rows, 17.10 MB)
[2021-03-31 15:17:14.004] [E/14] [info] [Task Finished] write to file in 0.032908s (112421 rows, 17.10 MB)
[2021-03-31 15:17:14.004] [E/10] [info] [Task Finished] write to file in 0.032989s (112573 rows, 17.12 MB)
[2021-03-31 15:17:14.004] [E/6] [info] [Task Finished] write to file in 0.033165s (112482 rows, 17.11 MB)
[2021-03-31 15:17:14.004] [E/5] [info] [Task Finished] write to file in 0.033182s (112467 rows, 17.11 MB)
[2021-03-31 15:17:14.004] [E/7] [info] [Task Finished] write to file in 0.033216s (112459 rows, 17.11 MB)
[2021-03-31 15:17:14.005] [E/1] [info] [Task Finished] write to file in 0.034209s (123424 rows, 18.78 MB)
[2021-03-31 15:17:14.006] [E/3] [info] [Task Finished] write to file in 0.034400s (123389 rows, 18.77 MB)
[2021-03-31 15:17:14.006] [E/4] [info] [Task Finished] write to file in 0.034524s (123299 rows, 18.76 MB)
[2021-03-31 15:17:14.006] [E/9] [info] [Task Finished] write to file in 0.034546s (123377 rows, 18.77 MB)
[2021-03-31 15:17:14.006] [driver] [info] [Task Finished] write to file in 0.034664s (123251 rows, 18.75 MB)
[2021-03-31 15:17:14.006] [E/8] [info] [Task Finished] write to file in 0.034712s (123410 rows, 18.78 MB)
[2021-03-31 15:17:14.007] [E/2] [info] [Task Finished] write to file in 0.035437s (112411 rows, 17.10 MB)
[2021-03-31 15:17:14.007] [global] [info] writing output took 0.063941s
[2021-03-31 15:17:14.007] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0640321s
[2021-03-31 15:17:14.007] [global] [info] [Transform Stage] Stage 0 took 774.917s
[2021-03-31 15:17:14.007] [global] [info] Query Execution took 774.997s. (planning: 0.0791042s, execution: 774.917s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005507230758666992
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 775.2805001735687 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0226492,"llvm_optimization_time_s":0.331094,"llvm_compilation_time_s":0.152234,"total_compilation_time_s":0.500928,"sampling_time_s":0.111045,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.6622,"fast_path_time_s":2.82629,"fast_path_per_row_time_ns":792.575,"slow_path_wall_time_s":12112.5,"slow_path_time_s":771.526,"slow_path_per_row_time_ns":1.75647e+06}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.005507230758666992, "jobTime": 775.2805001735687, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-31 15:17:22.317] [local execution engine] [info] Stopped local executor E/1
[2021-03-31 15:17:22.322] [local execution engine] [info] Stopped local executor E/2
[2021-03-31 15:17:22.327] [local execution engine] [info] Stopped local executor E/3
[2021-03-31 15:17:22.332] [local execution engine] [info] Stopped local executor E/4
[2021-03-31 15:17:22.338] [local execution engine] [info] Stopped local executor E/5
[2021-03-31 15:17:22.343] [local execution engine] [info] Stopped local executor E/6
[2021-03-31 15:17:22.348] [local execution engine] [info] Stopped local executor E/7
[2021-03-31 15:17:22.353] [local execution engine] [info] Stopped local executor E/8
[2021-03-31 15:17:22.358] [local execution engine] [info] Stopped local executor E/9
[2021-03-31 15:17:22.363] [local execution engine] [info] Stopped local executor E/10
[2021-03-31 15:17:22.368] [local execution engine] [info] Stopped local executor E/11
[2021-03-31 15:17:22.373] [local execution engine] [info] Stopped local executor E/12
[2021-03-31 15:17:22.378] [local execution engine] [info] Stopped local executor E/13
[2021-03-31 15:17:22.383] [local execution engine] [info] Stopped local executor E/14
[2021-03-31 15:17:22.388] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
