[2022-02-19 21:45:14.289] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.3.1-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2022-02-19 21:45:14.289] [local ee] [info] initializing LLVM backend
[2022-02-19 21:45:14.289] [local ee] [warning] init JIT compiler also only in local mode
[2022-02-19 21:45:14.289] [LLVM] [info] compiling code for skylake-avx512
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.290] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.291] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.291] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.291] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.291] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.291] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/1] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/1] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/2] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/2] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/3] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/3] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/4] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/5] [info] starting detached process queue
[2022-02-19 21:45:14.291] [E/4] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/5] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/6] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/6] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/7] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/8] [info] starting detached process queue
[2022-02-19 21:45:14.291] [E/7] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/8] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/9] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/9] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/10] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/10] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/11] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/12] [info] starting detached process queue
[2022-02-19 21:45:14.291] [E/11] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [E/12] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.291] [E/13] [info] starting detached process queue
[2022-02-19 21:45:14.291] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.292] [E/13] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.292] [E/14] [info] starting detached process queue
[2022-02-19 21:45:14.292] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.292] [E/14] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.292] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2022-02-19 21:45:14.292] [E/15] [info] starting detached process queue
[2022-02-19 21:45:14.292] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
[2022-02-19 21:45:14.292] [E/15] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:45:14.292] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2022-02-19 21:45:14.292] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2022-02-19 21:45:14.461] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:45:14.693] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:45:14.726] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:45:14.727] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:45:14.730] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:45:14.731] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:45:14.733] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:45:14.734] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:45:14.751] [logical planner] [info] logical optimization took 0.023267ms
[2022-02-19 21:45:14.752] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2022-02-19 21:45:14.752] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2022-02-19 21:45:14.753] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2022-02-19 21:45:14.754] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2022-02-19 21:45:14.754] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2022-02-19 21:45:14.755] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2022-02-19 21:45:14.755] [codegen] [info] generating lambda function for (Option[str]) -> str
[2022-02-19 21:45:14.756] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2022-02-19 21:45:14.757] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2022-02-19 21:45:14.758] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2022-02-19 21:45:14.759] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2022-02-19 21:45:14.760] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-19 21:45:14.761] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-19 21:45:14.762] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2022-02-19 21:45:14.763] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2022-02-19 21:45:14.764] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2022-02-19 21:45:14.765] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2022-02-19 21:45:14.765] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2022-02-19 21:45:14.766] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2022-02-19 21:45:14.766] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2022-02-19 21:45:14.767] [codegen] [info] generating lambda function for (Option[str]) -> str
[2022-02-19 21:45:14.768] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2022-02-19 21:45:14.769] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2022-02-19 21:45:14.770] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2022-02-19 21:45:14.771] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2022-02-19 21:45:14.772] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2022-02-19 21:45:14.773] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-19 21:45:14.773] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-19 21:45:14.774] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2022-02-19 21:45:14.830] [global] [info] retrieved metrics object
[2022-02-19 21:45:15.162] [global] [info] Optimization via LLVM passes took 0.338446 ms
[2022-02-19 21:45:15.162] [global] [info] starting code compilation
[2022-02-19 21:45:15.162] [global] [info] first compile done
[2022-02-19 21:45:15.317] [global] [info] functor Stage_0 retrieved from llvm
[2022-02-19 21:45:15.317] [global] [info] retrieving init/release stage functors
[2022-02-19 21:45:15.317] [global] [info] Compiled code paths for stage 0 in 0.16 ms
[2022-02-19 21:45:15.317] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.51109s
[2022-02-19 21:45:15.318] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2022-02-19 21:45:15.597] [driver] [info] [Task Finished] Transform to mem in 0.279487s (11005 normal rows, 42744 exceptions)
[2022-02-19 21:45:15.598] [E/12] [info] [Task Finished] Transform to mem in 0.280313s (11047 normal rows, 43210 exceptions)
[2022-02-19 21:45:15.598] [E/7] [info] [Task Finished] Transform to mem in 0.280359s (10997 normal rows, 42873 exceptions)
[2022-02-19 21:45:15.598] [E/1] [info] [Task Finished] Transform to mem in 0.280396s (11036 normal rows, 43142 exceptions)
[2022-02-19 21:45:15.599] [E/14] [info] [Task Finished] Transform to mem in 0.280722s (11026 normal rows, 43206 exceptions)
[2022-02-19 21:45:15.599] [E/2] [info] [Task Finished] Transform to mem in 0.280756s (11036 normal rows, 43139 exceptions)
[2022-02-19 21:45:15.599] [E/11] [info] [Task Finished] Transform to mem in 0.281137s (10987 normal rows, 43113 exceptions)
[2022-02-19 21:45:15.599] [E/5] [info] [Task Finished] Transform to mem in 0.281253s (11086 normal rows, 43015 exceptions)
[2022-02-19 21:45:15.599] [E/6] [info] [Task Finished] Transform to mem in 0.281416s (11105 normal rows, 43095 exceptions)
[2022-02-19 21:45:15.599] [E/10] [info] [Task Finished] Transform to mem in 0.281493s (11005 normal rows, 42741 exceptions)
[2022-02-19 21:45:15.599] [E/9] [info] [Task Finished] Transform to mem in 0.281519s (11153 normal rows, 42968 exceptions)
[2022-02-19 21:45:15.600] [E/3] [info] [Task Finished] Transform to mem in 0.281904s (11153 normal rows, 42970 exceptions)
[2022-02-19 21:45:15.600] [E/8] [info] [Task Finished] Transform to mem in 0.282300s (10997 normal rows, 42910 exceptions)
[2022-02-19 21:45:15.600] [E/4] [info] [Task Finished] Transform to mem in 0.282404s (11073 normal rows, 43414 exceptions)
[2022-02-19 21:45:15.600] [E/15] [info] [Task Finished] Transform to mem in 0.282441s (11008 normal rows, 43077 exceptions)
[2022-02-19 21:45:15.600] [E/13] [info] [Task Finished] Transform to mem in 0.282574s (11092 normal rows, 43495 exceptions)
[2022-02-19 21:45:15.876] [driver] [info] [Task Finished] Transform to mem in 0.278731s (11086 normal rows, 42996 exceptions)
[2022-02-19 21:45:15.878] [E/12] [info] [Task Finished] Transform to mem in 0.279801s (11092 normal rows, 43505 exceptions)
[2022-02-19 21:45:15.878] [E/1] [info] [Task Finished] Transform to mem in 0.279946s (11026 normal rows, 43205 exceptions)
[2022-02-19 21:45:15.878] [E/11] [info] [Task Finished] Transform to mem in 0.279301s (11036 normal rows, 43115 exceptions)
[2022-02-19 21:45:15.878] [E/2] [info] [Task Finished] Transform to mem in 0.279768s (11023 normal rows, 42910 exceptions)
[2022-02-19 21:45:15.878] [E/7] [info] [Task Finished] Transform to mem in 0.280187s (11153 normal rows, 42978 exceptions)
[2022-02-19 21:45:15.879] [E/14] [info] [Task Finished] Transform to mem in 0.279898s (10982 normal rows, 43059 exceptions)
[2022-02-19 21:45:15.879] [E/9] [info] [Task Finished] Transform to mem in 0.279467s (11111 normal rows, 42961 exceptions)
[2022-02-19 21:45:15.879] [E/10] [info] [Task Finished] Transform to mem in 0.279941s (11079 normal rows, 43539 exceptions)
[2022-02-19 21:45:15.880] [E/6] [info] [Task Finished] Transform to mem in 0.280208s (11086 normal rows, 42970 exceptions)
[2022-02-19 21:45:15.880] [E/3] [info] [Task Finished] Transform to mem in 0.280072s (11076 normal rows, 43220 exceptions)
[2022-02-19 21:45:15.881] [E/5] [info] [Task Finished] Transform to mem in 0.281515s (11005 normal rows, 42772 exceptions)
[2022-02-19 21:45:15.881] [E/15] [info] [Task Finished] Transform to mem in 0.280612s (11036 normal rows, 43053 exceptions)
[2022-02-19 21:45:15.881] [E/8] [info] [Task Finished] Transform to mem in 0.280876s (10987 normal rows, 43068 exceptions)
[2022-02-19 21:45:15.881] [E/4] [info] [Task Finished] Transform to mem in 0.280955s (11023 normal rows, 42880 exceptions)
[2022-02-19 21:45:15.882] [E/13] [info] [Task Finished] Transform to mem in 0.281361s (10992 normal rows, 42864 exceptions)
[2022-02-19 21:45:16.151] [driver] [info] [Task Finished] Transform to mem in 0.275278s (11099 normal rows, 42882 exceptions)
[2022-02-19 21:45:16.154] [E/12] [info] [Task Finished] Transform to mem in 0.276006s (11063 normal rows, 43617 exceptions)
[2022-02-19 21:45:16.154] [E/14] [info] [Task Finished] Transform to mem in 0.275805s (11026 normal rows, 43041 exceptions)
[2022-02-19 21:45:16.154] [E/9] [info] [Task Finished] Transform to mem in 0.275563s (11021 normal rows, 42887 exceptions)
[2022-02-19 21:45:16.155] [E/7] [info] [Task Finished] Transform to mem in 0.276051s (11004 normal rows, 42876 exceptions)
[2022-02-19 21:45:16.155] [E/1] [info] [Task Finished] Transform to mem in 0.276302s (11127 normal rows, 42969 exceptions)
[2022-02-19 21:45:16.155] [E/2] [info] [Task Finished] Transform to mem in 0.276478s (10987 normal rows, 43063 exceptions)
[2022-02-19 21:45:16.155] [E/11] [info] [Task Finished] Transform to mem in 0.277037s (11076 normal rows, 43221 exceptions)
[2022-02-19 21:45:16.156] [E/10] [info] [Task Finished] Transform to mem in 0.276355s (11064 normal rows, 42832 exceptions)
[2022-02-19 21:45:16.156] [E/6] [info] [Task Finished] Transform to mem in 0.276306s (11098 normal rows, 43603 exceptions)
[2022-02-19 21:45:16.156] [E/3] [info] [Task Finished] Transform to mem in 0.276479s (11127 normal rows, 43028 exceptions)
[2022-02-19 21:45:16.157] [E/5] [info] [Task Finished] Transform to mem in 0.276545s (11076 normal rows, 43212 exceptions)
[2022-02-19 21:45:16.158] [E/15] [info] [Task Finished] Transform to mem in 0.276637s (10987 normal rows, 43041 exceptions)
[2022-02-19 21:45:16.158] [E/8] [info] [Task Finished] Transform to mem in 0.276748s (11004 normal rows, 42913 exceptions)
[2022-02-19 21:45:16.158] [E/4] [info] [Task Finished] Transform to mem in 0.277036s (11026 normal rows, 43037 exceptions)
[2022-02-19 21:45:16.160] [E/13] [info] [Task Finished] Transform to mem in 0.278308s (11012 normal rows, 42883 exceptions)
[2022-02-19 21:45:16.427] [driver] [info] [Task Finished] Transform to mem in 0.275070s (11073 normal rows, 42820 exceptions)
[2022-02-19 21:45:16.430] [E/12] [info] [Task Finished] Transform to mem in 0.276083s (11095 normal rows, 43503 exceptions)
[2022-02-19 21:45:16.430] [E/14] [info] [Task Finished] Transform to mem in 0.276088s (11130 normal rows, 43084 exceptions)
[2022-02-19 21:45:16.431] [E/9] [info] [Task Finished] Transform to mem in 0.276317s (11076 normal rows, 43152 exceptions)
[2022-02-19 21:45:16.431] [E/7] [info] [Task Finished] Transform to mem in 0.276402s (10976 normal rows, 43110 exceptions)
[2022-02-19 21:45:16.431] [E/2] [info] [Task Finished] Transform to mem in 0.276163s (11026 normal rows, 43035 exceptions)
[2022-02-19 21:45:16.432] [E/10] [info] [Task Finished] Transform to mem in 0.275888s (11073 normal rows, 42754 exceptions)
[2022-02-19 21:45:16.432] [E/1] [info] [Task Finished] Transform to mem in 0.277410s (11015 normal rows, 42966 exceptions)
[2022-02-19 21:45:16.433] [E/11] [info] [Task Finished] Transform to mem in 0.277137s (11012 normal rows, 42888 exceptions)
[2022-02-19 21:45:16.433] [E/3] [info] [Task Finished] Transform to mem in 0.276445s (11130 normal rows, 43033 exceptions)
[2022-02-19 21:45:16.433] [E/6] [info] [Task Finished] Transform to mem in 0.277168s (11095 normal rows, 43552 exceptions)
[2022-02-19 21:45:16.434] [E/15] [info] [Task Finished] Transform to mem in 0.276365s (10974 normal rows, 43172 exceptions)
[2022-02-19 21:45:16.434] [E/5] [info] [Task Finished] Transform to mem in 0.277176s (11069 normal rows, 43142 exceptions)
[2022-02-19 21:45:16.434] [E/8] [info] [Task Finished] Transform to mem in 0.276591s (11008 normal rows, 42964 exceptions)
[2022-02-19 21:45:16.435] [E/4] [info] [Task Finished] Transform to mem in 0.276333s (11042 normal rows, 43023 exceptions)
[2022-02-19 21:45:16.437] [E/13] [info] [Task Finished] Transform to mem in 0.277006s (11012 normal rows, 42911 exceptions)
[2022-02-19 21:45:16.703] [driver] [info] [Task Finished] Transform to mem in 0.275957s (11063 normal rows, 42726 exceptions)
[2022-02-19 21:45:16.706] [E/14] [info] [Task Finished] Transform to mem in 0.276013s (11081 normal rows, 43050 exceptions)
[2022-02-19 21:45:16.707] [E/12] [info] [Task Finished] Transform to mem in 0.276400s (11105 normal rows, 43555 exceptions)
[2022-02-19 21:45:16.707] [E/9] [info] [Task Finished] Transform to mem in 0.276139s (11087 normal rows, 43150 exceptions)
[2022-02-19 21:45:16.707] [E/7] [info] [Task Finished] Transform to mem in 0.276129s (11005 normal rows, 43164 exceptions)
[2022-02-19 21:45:16.708] [E/10] [info] [Task Finished] Transform to mem in 0.276231s (11042 normal rows, 42959 exceptions)
[2022-02-19 21:45:16.708] [E/1] [info] [Task Finished] Transform to mem in 0.276338s (11002 normal rows, 42964 exceptions)
[2022-02-19 21:45:16.709] [E/2] [info] [Task Finished] Transform to mem in 0.277994s (11008 normal rows, 42975 exceptions)
[2022-02-19 21:45:16.709] [E/11] [info] [Task Finished] Transform to mem in 0.276658s (11073 normal rows, 42720 exceptions)
[2022-02-19 21:45:16.710] [E/3] [info] [Task Finished] Transform to mem in 0.276660s (11088 normal rows, 43511 exceptions)
[2022-02-19 21:45:16.710] [E/6] [info] [Task Finished] Transform to mem in 0.276824s (11098 normal rows, 43112 exceptions)
[2022-02-19 21:45:16.711] [E/15] [info] [Task Finished] Transform to mem in 0.276495s (11087 normal rows, 43044 exceptions)
[2022-02-19 21:45:16.711] [E/8] [info] [Task Finished] Transform to mem in 0.276303s (11008 normal rows, 43017 exceptions)
[2022-02-19 21:45:16.711] [E/4] [info] [Task Finished] Transform to mem in 0.276740s (11024 normal rows, 42947 exceptions)
[2022-02-19 21:45:16.712] [E/5] [info] [Task Finished] Transform to mem in 0.277405s (11005 normal rows, 43229 exceptions)
[2022-02-19 21:45:16.714] [E/13] [info] [Task Finished] Transform to mem in 0.277089s (11020 normal rows, 42976 exceptions)
[2022-02-19 21:45:16.978] [driver] [info] [Task Finished] Transform to mem in 0.275418s (11036 normal rows, 42710 exceptions)
[2022-02-19 21:45:16.983] [E/14] [info] [Task Finished] Transform to mem in 0.276420s (11125 normal rows, 43517 exceptions)
[2022-02-19 21:45:16.983] [E/9] [info] [Task Finished] Transform to mem in 0.276030s (11087 normal rows, 42938 exceptions)
[2022-02-19 21:45:16.983] [E/7] [info] [Task Finished] Transform to mem in 0.276326s (10985 normal rows, 43336 exceptions)
[2022-02-19 21:45:16.984] [E/12] [info] [Task Finished] Transform to mem in 0.277255s (11098 normal rows, 43115 exceptions)
[2022-02-19 21:45:16.984] [E/10] [info] [Task Finished] Transform to mem in 0.276084s (11000 normal rows, 42999 exceptions)
[2022-02-19 21:45:16.985] [E/1] [info] [Task Finished] Transform to mem in 0.276141s (11052 normal rows, 42881 exceptions)
[2022-02-19 21:45:16.985] [E/2] [info] [Task Finished] Transform to mem in 0.276284s (11020 normal rows, 43057 exceptions)
[2022-02-19 21:45:16.986] [E/3] [info] [Task Finished] Transform to mem in 0.276601s (11166 normal rows, 43520 exceptions)
[2022-02-19 21:45:16.986] [E/8] [info] [Task Finished] Transform to mem in 0.275711s (10999 normal rows, 43334 exceptions)
[2022-02-19 21:45:16.987] [E/15] [info] [Task Finished] Transform to mem in 0.276077s (11073 normal rows, 42970 exceptions)
[2022-02-19 21:45:16.987] [E/6] [info] [Task Finished] Transform to mem in 0.276764s (11098 normal rows, 43075 exceptions)
[2022-02-19 21:45:16.987] [E/11] [info] [Task Finished] Transform to mem in 0.277640s (10995 normal rows, 42708 exceptions)
[2022-02-19 21:45:16.988] [E/5] [info] [Task Finished] Transform to mem in 0.275739s (11052 normal rows, 42764 exceptions)
[2022-02-19 21:45:16.989] [E/4] [info] [Task Finished] Transform to mem in 0.277339s (11000 normal rows, 43009 exceptions)
[2022-02-19 21:45:16.992] [E/13] [info] [Task Finished] Transform to mem in 0.277282s (11020 normal rows, 43138 exceptions)
[2022-02-19 21:45:17.253] [driver] [info] [Task Finished] Transform to mem in 0.275357s (10995 normal rows, 42726 exceptions)
[2022-02-19 21:45:17.259] [E/9] [info] [Task Finished] Transform to mem in 0.276071s (11091 normal rows, 43047 exceptions)
[2022-02-19 21:45:17.260] [E/14] [info] [Task Finished] Transform to mem in 0.276617s (11166 normal rows, 43508 exceptions)
[2022-02-19 21:45:17.260] [E/7] [info] [Task Finished] Transform to mem in 0.276465s (11080 normal rows, 43031 exceptions)
[2022-02-19 21:45:17.261] [E/12] [info] [Task Finished] Transform to mem in 0.277183s (10999 normal rows, 43300 exceptions)
[2022-02-19 21:45:17.261] [E/1] [info] [Task Finished] Transform to mem in 0.276552s (11036 normal rows, 42720 exceptions)
[2022-02-19 21:45:17.262] [E/2] [info] [Task Finished] Transform to mem in 0.276332s (11016 normal rows, 43165 exceptions)
[2022-02-19 21:45:17.262] [E/10] [info] [Task Finished] Transform to mem in 0.278067s (11000 normal rows, 43043 exceptions)
[2022-02-19 21:45:17.263] [E/3] [info] [Task Finished] Transform to mem in 0.276499s (10995 normal rows, 42718 exceptions)
[2022-02-19 21:45:17.263] [E/8] [info] [Task Finished] Transform to mem in 0.276316s (11186 normal rows, 43465 exceptions)
[2022-02-19 21:45:17.264] [E/15] [info] [Task Finished] Transform to mem in 0.276927s (11001 normal rows, 43113 exceptions)
[2022-02-19 21:45:17.264] [E/6] [info] [Task Finished] Transform to mem in 0.277368s (11170 normal rows, 43024 exceptions)
[2022-02-19 21:45:17.264] [E/5] [info] [Task Finished] Transform to mem in 0.276578s (11010 normal rows, 43002 exceptions)
[2022-02-19 21:45:17.264] [E/11] [info] [Task Finished] Transform to mem in 0.277409s (10989 normal rows, 43282 exceptions)
[2022-02-19 21:45:17.266] [E/4] [info] [Task Finished] Transform to mem in 0.276765s (11002 normal rows, 42755 exceptions)
[2022-02-19 21:45:17.270] [E/13] [info] [Task Finished] Transform to mem in 0.278189s (11050 normal rows, 43199 exceptions)
[2022-02-19 21:45:17.529] [driver] [info] [Task Finished] Transform to mem in 0.275942s (10973 normal rows, 42686 exceptions)
[2022-02-19 21:45:17.535] [E/9] [info] [Task Finished] Transform to mem in 0.276304s (11160 normal rows, 43455 exceptions)
[2022-02-19 21:45:17.536] [E/7] [info] [Task Finished] Transform to mem in 0.276000s (11166 normal rows, 43023 exceptions)
[2022-02-19 21:45:17.536] [E/14] [info] [Task Finished] Transform to mem in 0.276368s (11045 normal rows, 43148 exceptions)
[2022-02-19 21:45:17.538] [E/12] [info] [Task Finished] Transform to mem in 0.276999s (10997 normal rows, 43283 exceptions)
[2022-02-19 21:45:17.538] [E/2] [info] [Task Finished] Transform to mem in 0.276640s (11007 normal rows, 42795 exceptions)
[2022-02-19 21:45:17.539] [E/1] [info] [Task Finished] Transform to mem in 0.277526s (11005 normal rows, 42971 exceptions)
[2022-02-19 21:45:17.539] [E/3] [info] [Task Finished] Transform to mem in 0.276201s (10973 normal rows, 42686 exceptions)
[2022-02-19 21:45:17.539] [E/10] [info] [Task Finished] Transform to mem in 0.277241s (11050 normal rows, 43196 exceptions)
[2022-02-19 21:45:17.540] [E/8] [info] [Task Finished] Transform to mem in 0.276897s (11160 normal rows, 43446 exceptions)
[2022-02-19 21:45:17.540] [E/15] [info] [Task Finished] Transform to mem in 0.276712s (11043 normal rows, 43153 exceptions)
[2022-02-19 21:45:17.541] [E/6] [info] [Task Finished] Transform to mem in 0.276752s (11168 normal rows, 43028 exceptions)
[2022-02-19 21:45:17.541] [E/5] [info] [Task Finished] Transform to mem in 0.276850s (10997 normal rows, 43277 exceptions)
[2022-02-19 21:45:17.542] [E/11] [info] [Task Finished] Transform to mem in 0.277552s (10997 normal rows, 42973 exceptions)
[2022-02-19 21:45:17.543] [E/4] [info] [Task Finished] Transform to mem in 0.277682s (11015 normal rows, 42799 exceptions)
[2022-02-19 21:45:17.548] [E/13] [info] [Task Finished] Transform to mem in 0.277955s (11050 normal rows, 43170 exceptions)
[2022-02-19 21:45:17.806] [driver] [info] [Task Finished] Transform to mem in 0.276522s (10973 normal rows, 42710 exceptions)
[2022-02-19 21:45:17.812] [E/9] [info] [Task Finished] Transform to mem in 0.276092s (11160 normal rows, 43431 exceptions)
[2022-02-19 21:45:17.812] [E/7] [info] [Task Finished] Transform to mem in 0.276028s (11043 normal rows, 43166 exceptions)
[2022-02-19 21:45:17.812] [E/14] [info] [Task Finished] Transform to mem in 0.276106s (11168 normal rows, 43027 exceptions)
[2022-02-19 21:45:17.814] [E/1] [info] [Task Finished] Transform to mem in 0.275647s (11009 normal rows, 42805 exceptions)
[2022-02-19 21:45:17.815] [E/12] [info] [Task Finished] Transform to mem in 0.276704s (10997 normal rows, 43237 exceptions)
[2022-02-19 21:45:17.815] [E/2] [info] [Task Finished] Transform to mem in 0.276388s (10997 normal rows, 43012 exceptions)
[2022-02-19 21:45:17.816] [E/3] [info] [Task Finished] Transform to mem in 0.276970s (11021 normal rows, 43160 exceptions)
[2022-02-19 21:45:17.816] [E/10] [info] [Task Finished] Transform to mem in 0.276653s (11003 normal rows, 42716 exceptions)
[2022-02-19 21:45:17.817] [E/8] [info] [Task Finished] Transform to mem in 0.276799s (11165 normal rows, 43354 exceptions)
[2022-02-19 21:45:17.817] [E/15] [info] [Task Finished] Transform to mem in 0.276359s (11043 normal rows, 43217 exceptions)
[2022-02-19 21:45:17.817] [E/6] [info] [Task Finished] Transform to mem in 0.276106s (11156 normal rows, 43044 exceptions)
[2022-02-19 21:45:17.817] [E/5] [info] [Task Finished] Transform to mem in 0.276240s (11009 normal rows, 43187 exceptions)
[2022-02-19 21:45:17.820] [E/11] [info] [Task Finished] Transform to mem in 0.278097s (10997 normal rows, 43067 exceptions)
[2022-02-19 21:45:17.821] [E/4] [info] [Task Finished] Transform to mem in 0.277340s (11009 normal rows, 42811 exceptions)
[2022-02-19 21:45:17.825] [E/13] [info] [Task Finished] Transform to mem in 0.277571s (11021 normal rows, 43162 exceptions)
[2022-02-19 21:45:18.082] [driver] [info] [Task Finished] Transform to mem in 0.275876s (11003 normal rows, 42716 exceptions)
[2022-02-19 21:45:18.087] [E/9] [info] [Task Finished] Transform to mem in 0.275483s (11165 normal rows, 43260 exceptions)
[2022-02-19 21:45:18.087] [E/7] [info] [Task Finished] Transform to mem in 0.275397s (11027 normal rows, 43245 exceptions)
[2022-02-19 21:45:18.088] [E/14] [info] [Task Finished] Transform to mem in 0.276388s (11172 normal rows, 43107 exceptions)
[2022-02-19 21:45:18.090] [E/1] [info] [Task Finished] Transform to mem in 0.275985s (10997 normal rows, 43177 exceptions)
[2022-02-19 21:45:18.092] [E/2] [info] [Task Finished] Transform to mem in 0.276660s (10999 normal rows, 42828 exceptions)
[2022-02-19 21:45:18.092] [E/12] [info] [Task Finished] Transform to mem in 0.276789s (11009 normal rows, 43050 exceptions)
[2022-02-19 21:45:18.092] [E/10] [info] [Task Finished] Transform to mem in 0.275668s (11000 normal rows, 42726 exceptions)
[2022-02-19 21:45:18.092] [E/8] [info] [Task Finished] Transform to mem in 0.275744s (11091 normal rows, 43230 exceptions)
[2022-02-19 21:45:18.093] [E/3] [info] [Task Finished] Transform to mem in 0.277257s (11031 normal rows, 43157 exceptions)
[2022-02-19 21:45:18.093] [E/15] [info] [Task Finished] Transform to mem in 0.276511s (11099 normal rows, 43272 exceptions)
[2022-02-19 21:45:18.093] [E/5] [info] [Task Finished] Transform to mem in 0.275927s (10997 normal rows, 43174 exceptions)
[2022-02-19 21:45:18.094] [E/6] [info] [Task Finished] Transform to mem in 0.276597s (11177 normal rows, 43113 exceptions)
[2022-02-19 21:45:18.097] [E/11] [info] [Task Finished] Transform to mem in 0.276676s (10987 normal rows, 43020 exceptions)
[2022-02-19 21:45:18.097] [E/4] [info] [Task Finished] Transform to mem in 0.276724s (11020 normal rows, 42867 exceptions)
[2022-02-19 21:45:18.136] [E/13] [info] [Task Finished] Transform to mem in 0.310841s (12330 normal rows, 48094 exceptions)
[2022-02-19 21:45:18.136] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.81895s
[2022-02-19 21:45:18.136] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.4166s, 56350770 input rows, time to process 1 row via fast path: 0.000788217ms
[2022-02-19 21:45:18.136] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2022-02-19 21:45:18.141] [local ee] [info] compiled pure python pipeline in 0.004428s
[2022-02-19 21:45:18.141] [local ee] [info] creating hybrid intermediates took 0.000004s
[2022-02-19 21:45:18.142] [local ee] [info] Created 160 resolve tasks in 0.001274s
[2022-02-19 21:45:18.142] [local ee] [info] 160/160 tasks require executing the slow path.
[2022-02-19 21:45:18.158] [E/12] [info] [Task Finished] Resolve in 0.015788s
[2022-02-19 21:45:18.158] [E/1] [info] [Task Finished] Resolve in 0.015868s
[2022-02-19 21:45:18.158] [E/11] [info] [Task Finished] Resolve in 0.015956s
[2022-02-19 21:45:18.158] [E/4] [info] [Task Finished] Resolve in 0.015962s
[2022-02-19 21:45:18.158] [E/8] [info] [Task Finished] Resolve in 0.015961s
[2022-02-19 21:45:18.158] [E/2] [info] [Task Finished] Resolve in 0.015983s
[2022-02-19 21:45:18.158] [E/9] [info] [Task Finished] Resolve in 0.015992s
[2022-02-19 21:45:18.158] [E/7] [info] [Task Finished] Resolve in 0.016001s
[2022-02-19 21:45:18.158] [driver] [info] [Task Finished] Resolve in 0.016017s
[2022-02-19 21:45:18.158] [E/10] [info] [Task Finished] Resolve in 0.016028s
[2022-02-19 21:45:18.158] [E/14] [info] [Task Finished] Resolve in 0.016028s
[2022-02-19 21:45:18.158] [E/6] [info] [Task Finished] Resolve in 0.016061s
[2022-02-19 21:45:18.158] [E/5] [info] [Task Finished] Resolve in 0.016034s
[2022-02-19 21:45:18.158] [E/3] [info] [Task Finished] Resolve in 0.016051s
[2022-02-19 21:45:18.158] [E/13] [info] [Task Finished] Resolve in 0.016092s
[2022-02-19 21:45:18.158] [E/15] [info] [Task Finished] Resolve in 0.016129s
[2022-02-19 21:45:18.174] [E/12] [info] [Task Finished] Resolve in 0.015931s
[2022-02-19 21:45:18.174] [E/11] [info] [Task Finished] Resolve in 0.015838s
[2022-02-19 21:45:18.174] [E/8] [info] [Task Finished] Resolve in 0.015847s
[2022-02-19 21:45:18.174] [E/6] [info] [Task Finished] Resolve in 0.015777s
[2022-02-19 21:45:18.174] [E/7] [info] [Task Finished] Resolve in 0.015849s
[2022-02-19 21:45:18.174] [E/2] [info] [Task Finished] Resolve in 0.015884s
[2022-02-19 21:45:18.174] [E/15] [info] [Task Finished] Resolve in 0.015742s
[2022-02-19 21:45:18.174] [E/9] [info] [Task Finished] Resolve in 0.015907s
[2022-02-19 21:45:18.174] [E/1] [info] [Task Finished] Resolve in 0.016038s
[2022-02-19 21:45:18.174] [E/4] [info] [Task Finished] Resolve in 0.015945s
[2022-02-19 21:45:18.174] [E/10] [info] [Task Finished] Resolve in 0.015897s
[2022-02-19 21:45:18.174] [E/3] [info] [Task Finished] Resolve in 0.015858s
[2022-02-19 21:45:18.174] [E/13] [info] [Task Finished] Resolve in 0.015859s
[2022-02-19 21:45:18.174] [driver] [info] [Task Finished] Resolve in 0.015992s
[2022-02-19 21:45:18.174] [E/5] [info] [Task Finished] Resolve in 0.015946s
[2022-02-19 21:45:18.174] [E/14] [info] [Task Finished] Resolve in 0.016045s
[2022-02-19 21:45:18.190] [E/12] [info] [Task Finished] Resolve in 0.015925s
[2022-02-19 21:45:18.190] [E/6] [info] [Task Finished] Resolve in 0.015893s
[2022-02-19 21:45:18.190] [E/7] [info] [Task Finished] Resolve in 0.015934s
[2022-02-19 21:45:18.190] [E/8] [info] [Task Finished] Resolve in 0.015969s
[2022-02-19 21:45:18.190] [E/15] [info] [Task Finished] Resolve in 0.015935s
[2022-02-19 21:45:18.190] [E/2] [info] [Task Finished] Resolve in 0.015972s
[2022-02-19 21:45:18.190] [E/1] [info] [Task Finished] Resolve in 0.015928s
[2022-02-19 21:45:18.190] [E/10] [info] [Task Finished] Resolve in 0.015912s
[2022-02-19 21:45:18.190] [driver] [info] [Task Finished] Resolve in 0.015865s
[2022-02-19 21:45:18.190] [E/3] [info] [Task Finished] Resolve in 0.015936s
[2022-02-19 21:45:18.190] [E/11] [info] [Task Finished] Resolve in 0.016085s
[2022-02-19 21:45:18.190] [E/9] [info] [Task Finished] Resolve in 0.016040s
[2022-02-19 21:45:18.190] [E/13] [info] [Task Finished] Resolve in 0.015966s
[2022-02-19 21:45:18.190] [E/14] [info] [Task Finished] Resolve in 0.015903s
[2022-02-19 21:45:18.190] [E/5] [info] [Task Finished] Resolve in 0.015989s
[2022-02-19 21:45:18.190] [E/4] [info] [Task Finished] Resolve in 0.016264s
[2022-02-19 21:45:18.206] [E/12] [info] [Task Finished] Resolve in 0.015808s
[2022-02-19 21:45:18.206] [E/7] [info] [Task Finished] Resolve in 0.015809s
[2022-02-19 21:45:18.206] [E/1] [info] [Task Finished] Resolve in 0.015770s
[2022-02-19 21:45:18.206] [driver] [info] [Task Finished] Resolve in 0.015744s
[2022-02-19 21:45:18.206] [E/8] [info] [Task Finished] Resolve in 0.015850s
[2022-02-19 21:45:18.206] [E/15] [info] [Task Finished] Resolve in 0.015816s
[2022-02-19 21:45:18.206] [E/3] [info] [Task Finished] Resolve in 0.015799s
[2022-02-19 21:45:18.206] [E/2] [info] [Task Finished] Resolve in 0.015856s
[2022-02-19 21:45:18.206] [E/10] [info] [Task Finished] Resolve in 0.015836s
[2022-02-19 21:45:18.206] [E/6] [info] [Task Finished] Resolve in 0.016071s
[2022-02-19 21:45:18.206] [E/9] [info] [Task Finished] Resolve in 0.015904s
[2022-02-19 21:45:18.206] [E/14] [info] [Task Finished] Resolve in 0.015868s
[2022-02-19 21:45:18.206] [E/13] [info] [Task Finished] Resolve in 0.015932s
[2022-02-19 21:45:18.206] [E/11] [info] [Task Finished] Resolve in 0.016038s
[2022-02-19 21:45:18.206] [E/5] [info] [Task Finished] Resolve in 0.015933s
[2022-02-19 21:45:18.206] [E/4] [info] [Task Finished] Resolve in 0.015782s
[2022-02-19 21:45:18.222] [E/12] [info] [Task Finished] Resolve in 0.015852s
[2022-02-19 21:45:18.222] [E/7] [info] [Task Finished] Resolve in 0.015873s
[2022-02-19 21:45:18.222] [E/3] [info] [Task Finished] Resolve in 0.015835s
[2022-02-19 21:45:18.222] [driver] [info] [Task Finished] Resolve in 0.015909s
[2022-02-19 21:45:18.222] [E/10] [info] [Task Finished] Resolve in 0.015857s
[2022-02-19 21:45:18.222] [E/15] [info] [Task Finished] Resolve in 0.015916s
[2022-02-19 21:45:18.222] [E/8] [info] [Task Finished] Resolve in 0.015941s
[2022-02-19 21:45:18.222] [E/2] [info] [Task Finished] Resolve in 0.015910s
[2022-02-19 21:45:18.222] [E/1] [info] [Task Finished] Resolve in 0.016144s
[2022-02-19 21:45:18.222] [E/9] [info] [Task Finished] Resolve in 0.015939s
[2022-02-19 21:45:18.222] [E/14] [info] [Task Finished] Resolve in 0.015925s
[2022-02-19 21:45:18.222] [E/4] [info] [Task Finished] Resolve in 0.015908s
[2022-02-19 21:45:18.222] [E/13] [info] [Task Finished] Resolve in 0.015996s
[2022-02-19 21:45:18.222] [E/11] [info] [Task Finished] Resolve in 0.015939s
[2022-02-19 21:45:18.222] [E/5] [info] [Task Finished] Resolve in 0.016045s
[2022-02-19 21:45:18.222] [E/6] [info] [Task Finished] Resolve in 0.016205s
[2022-02-19 21:45:18.237] [E/12] [info] [Task Finished] Resolve in 0.015645s
[2022-02-19 21:45:18.237] [E/3] [info] [Task Finished] Resolve in 0.015637s
[2022-02-19 21:45:18.238] [E/15] [info] [Task Finished] Resolve in 0.015644s
[2022-02-19 21:45:18.238] [E/8] [info] [Task Finished] Resolve in 0.015637s
[2022-02-19 21:45:18.238] [E/2] [info] [Task Finished] Resolve in 0.015663s
[2022-02-19 21:45:18.238] [driver] [info] [Task Finished] Resolve in 0.015711s
[2022-02-19 21:45:18.238] [E/10] [info] [Task Finished] Resolve in 0.015697s
[2022-02-19 21:45:18.238] [E/7] [info] [Task Finished] Resolve in 0.015910s
[2022-02-19 21:45:18.238] [E/11] [info] [Task Finished] Resolve in 0.015615s
[2022-02-19 21:45:18.238] [E/14] [info] [Task Finished] Resolve in 0.015755s
[2022-02-19 21:45:18.238] [E/13] [info] [Task Finished] Resolve in 0.015659s
[2022-02-19 21:45:18.238] [E/4] [info] [Task Finished] Resolve in 0.015721s
[2022-02-19 21:45:18.238] [E/9] [info] [Task Finished] Resolve in 0.015828s
[2022-02-19 21:45:18.238] [E/1] [info] [Task Finished] Resolve in 0.016003s
[2022-02-19 21:45:18.238] [E/6] [info] [Task Finished] Resolve in 0.015764s
[2022-02-19 21:45:18.238] [E/5] [info] [Task Finished] Resolve in 0.015788s
[2022-02-19 21:45:18.253] [E/12] [info] [Task Finished] Resolve in 0.015808s
[2022-02-19 21:45:18.253] [E/3] [info] [Task Finished] Resolve in 0.015866s
[2022-02-19 21:45:18.253] [driver] [info] [Task Finished] Resolve in 0.015765s
[2022-02-19 21:45:18.253] [E/8] [info] [Task Finished] Resolve in 0.015840s
[2022-02-19 21:45:18.254] [E/2] [info] [Task Finished] Resolve in 0.015933s
[2022-02-19 21:45:18.254] [E/7] [info] [Task Finished] Resolve in 0.015870s
[2022-02-19 21:45:18.254] [E/10] [info] [Task Finished] Resolve in 0.015957s
[2022-02-19 21:45:18.254] [E/11] [info] [Task Finished] Resolve in 0.015772s
[2022-02-19 21:45:18.254] [E/15] [info] [Task Finished] Resolve in 0.016112s
[2022-02-19 21:45:18.254] [E/13] [info] [Task Finished] Resolve in 0.015889s
[2022-02-19 21:45:18.254] [E/4] [info] [Task Finished] Resolve in 0.015903s
[2022-02-19 21:45:18.254] [E/9] [info] [Task Finished] Resolve in 0.015898s
[2022-02-19 21:45:18.254] [E/6] [info] [Task Finished] Resolve in 0.015778s
[2022-02-19 21:45:18.254] [E/1] [info] [Task Finished] Resolve in 0.015851s
[2022-02-19 21:45:18.254] [E/5] [info] [Task Finished] Resolve in 0.015973s
[2022-02-19 21:45:18.254] [E/14] [info] [Task Finished] Resolve in 0.016243s
[2022-02-19 21:45:18.270] [E/12] [info] [Task Finished] Resolve in 0.016609s
[2022-02-19 21:45:18.270] [driver] [info] [Task Finished] Resolve in 0.016780s
[2022-02-19 21:45:18.270] [E/8] [info] [Task Finished] Resolve in 0.016784s
[2022-02-19 21:45:18.270] [E/7] [info] [Task Finished] Resolve in 0.016717s
[2022-02-19 21:45:18.270] [E/11] [info] [Task Finished] Resolve in 0.016706s
[2022-02-19 21:45:18.270] [E/10] [info] [Task Finished] Resolve in 0.016787s
[2022-02-19 21:45:18.270] [E/2] [info] [Task Finished] Resolve in 0.016848s
[2022-02-19 21:45:18.270] [E/3] [info] [Task Finished] Resolve in 0.017142s
[2022-02-19 21:45:18.271] [E/15] [info] [Task Finished] Resolve in 0.016888s
[2022-02-19 21:45:18.271] [E/1] [info] [Task Finished] Resolve in 0.016823s
[2022-02-19 21:45:18.271] [E/6] [info] [Task Finished] Resolve in 0.016917s
[2022-02-19 21:45:18.271] [E/4] [info] [Task Finished] Resolve in 0.016949s
[2022-02-19 21:45:18.271] [E/9] [info] [Task Finished] Resolve in 0.016964s
[2022-02-19 21:45:18.271] [E/13] [info] [Task Finished] Resolve in 0.017203s
[2022-02-19 21:45:18.271] [E/5] [info] [Task Finished] Resolve in 0.016920s
[2022-02-19 21:45:18.271] [E/14] [info] [Task Finished] Resolve in 0.017035s
[2022-02-19 21:45:18.287] [E/12] [info] [Task Finished] Resolve in 0.017112s
[2022-02-19 21:45:18.287] [E/8] [info] [Task Finished] Resolve in 0.017173s
[2022-02-19 21:45:18.287] [E/7] [info] [Task Finished] Resolve in 0.017185s
[2022-02-19 21:45:18.287] [E/11] [info] [Task Finished] Resolve in 0.017130s
[2022-02-19 21:45:18.288] [driver] [info] [Task Finished] Resolve in 0.017422s
[2022-02-19 21:45:18.288] [E/15] [info] [Task Finished] Resolve in 0.017044s
[2022-02-19 21:45:18.288] [E/10] [info] [Task Finished] Resolve in 0.017239s
[2022-02-19 21:45:18.288] [E/2] [info] [Task Finished] Resolve in 0.017386s
[2022-02-19 21:45:18.288] [E/3] [info] [Task Finished] Resolve in 0.017487s
[2022-02-19 21:45:18.288] [E/6] [info] [Task Finished] Resolve in 0.017485s
[2022-02-19 21:45:18.288] [E/4] [info] [Task Finished] Resolve in 0.017546s
[2022-02-19 21:45:18.288] [E/9] [info] [Task Finished] Resolve in 0.017619s
[2022-02-19 21:45:18.288] [E/1] [info] [Task Finished] Resolve in 0.017692s
[2022-02-19 21:45:18.289] [E/13] [info] [Task Finished] Resolve in 0.017502s
[2022-02-19 21:45:18.289] [E/5] [info] [Task Finished] Resolve in 0.017521s
[2022-02-19 21:45:18.289] [E/14] [info] [Task Finished] Resolve in 0.017539s
[2022-02-19 21:45:18.303] [E/12] [info] [Task Finished] Resolve in 0.016182s
[2022-02-19 21:45:18.303] [E/7] [info] [Task Finished] Resolve in 0.015914s
[2022-02-19 21:45:18.303] [E/15] [info] [Task Finished] Resolve in 0.015840s
[2022-02-19 21:45:18.303] [E/11] [info] [Task Finished] Resolve in 0.015965s
[2022-02-19 21:45:18.303] [E/8] [info] [Task Finished] Resolve in 0.016097s
[2022-02-19 21:45:18.303] [driver] [info] [Task Finished] Resolve in 0.015892s
[2022-02-19 21:45:18.304] [E/10] [info] [Task Finished] Resolve in 0.015899s
[2022-02-19 21:45:18.304] [E/2] [info] [Task Finished] Resolve in 0.015786s
[2022-02-19 21:45:18.304] [E/3] [info] [Task Finished] Resolve in 0.015957s
[2022-02-19 21:45:18.304] [E/6] [info] [Task Finished] Resolve in 0.015839s
[2022-02-19 21:45:18.304] [E/1] [info] [Task Finished] Resolve in 0.015786s
[2022-02-19 21:45:18.304] [E/9] [info] [Task Finished] Resolve in 0.015851s
[2022-02-19 21:45:18.304] [E/13] [info] [Task Finished] Resolve in 0.015812s
[2022-02-19 21:45:18.304] [E/5] [info] [Task Finished] Resolve in 0.015777s
[2022-02-19 21:45:18.304] [E/4] [info] [Task Finished] Resolve in 0.015955s
[2022-02-19 21:45:18.306] [E/14] [info] [Task Finished] Resolve in 0.017565s
[2022-02-19 21:45:18.306] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.170071s
[2022-02-19 21:45:18.306] [local ee] [info] slow path for Stage 0: total wall clock time: 2.58524s, time to process 1 row via slow path: 0.000374894ms
[2022-02-19 21:45:18.306] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.170101s

[2022-02-19 21:45:18.307] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2022-02-19 21:45:18.332] [E/14] [info] [Task Finished] write to file in 0.024754s (102395 rows, 15.59 MB)
[2022-02-19 21:45:18.333] [E/8] [info] [Task Finished] write to file in 0.026438s (123508 rows, 18.80 MB)
[2022-02-19 21:45:18.333] [E/12] [info] [Task Finished] write to file in 0.026440s (123474 rows, 18.80 MB)
[2022-02-19 21:45:18.333] [E/5] [info] [Task Finished] write to file in 0.026523s (123479 rows, 18.80 MB)
[2022-02-19 21:45:18.334] [E/10] [info] [Task Finished] write to file in 0.027247s (112425 rows, 17.11 MB)
[2022-02-19 21:45:18.334] [E/13] [info] [Task Finished] write to file in 0.027429s (112421 rows, 17.11 MB)
[2022-02-19 21:45:18.336] [E/15] [info] [Task Finished] write to file in 0.028852s (123413 rows, 18.79 MB)
[2022-02-19 21:45:18.336] [E/7] [info] [Task Finished] write to file in 0.028921s (123474 rows, 18.80 MB)
[2022-02-19 21:45:18.336] [E/6] [info] [Task Finished] write to file in 0.028935s (123598 rows, 18.82 MB)
[2022-02-19 21:45:18.336] [E/2] [info] [Task Finished] write to file in 0.028909s (123570 rows, 18.81 MB)
[2022-02-19 21:45:18.336] [E/3] [info] [Task Finished] write to file in 0.028925s (123458 rows, 18.80 MB)
[2022-02-19 21:45:18.336] [E/4] [info] [Task Finished] write to file in 0.029110s (123704 rows, 18.83 MB)
[2022-02-19 21:45:18.336] [E/11] [info] [Task Finished] write to file in 0.029113s (123752 rows, 18.84 MB)
[2022-02-19 21:45:18.336] [E/9] [info] [Task Finished] write to file in 0.029135s (123409 rows, 18.79 MB)
[2022-02-19 21:45:18.340] [E/1] [info] [Task Finished] write to file in 0.032877s (112411 rows, 17.11 MB)
[2022-02-19 21:45:18.340] [global] [info] writing output took 0.033359s
[2022-02-19 21:45:18.340] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0334635s
[2022-02-19 21:45:18.340] [global] [info] [Transform Stage] Stage 0 took 3.53385s
[2022-02-19 21:45:18.340] [global] [info] Query Execution took 3.61543s. (planning: 0.0815507s, execution: 3.53388s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.3.1
            |_|
    
using Python 3.6.9 (default, Feb  8 2022, 16:30:43) 
[GCC 9.3.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.009322643280029297
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 4.049562931060791 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.optimizer.mergeExceptionsInOrder': True, 'tuplex.optimizer.operatorReordering': False, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.network.verifySSL': False, 'tuplex.redirectToPythonLogging': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.optionalThreshold': 0.7, 'tuplex.aws.connectTimeout': '1', 'tuplex.aws.httpThreadCount': '32', 'tuplex.aws.lambdaMemory': '1536', 'tuplex.aws.lambdaTimeout': '600', 'tuplex.aws.maxConcurrency': '100', 'tuplex.aws.region': 'us-east-1', 'tuplex.aws.requestTimeout': '600', 'tuplex.aws.requesterPay': 'false', 'tuplex.aws.scratchDir': '', 'tuplex.backend': 'local', 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': 'cc956b40c9fa', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.network.caFile': '', 'tuplex.network.caPath': '', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.3.1-py3.6.egg/tuplex/libexec/tuplex_runtime.so', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp/tuplex-cache-tuplex', 'tuplex.webui.mongodb.path': '/tmp/tuplex-cache-tuplex/mongodb', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0232669,"llvm_optimization_time_s":0.338446,"llvm_compilation_time_s":0.155225,"total_compilation_time_s":0.511088,"sampling_time_s":0.114993,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.4166,"fast_path_time_s":2.81897,"fast_path_per_row_time_ns":788.217,"slow_path_wall_time_s":2.58524,"slow_path_time_s":0.170071,"slow_path_per_row_time_ns":374.894,"partitions_swapin_count":0,"partitions_swapout_count":0,"partitions_bytes_swapped_in":0,"partitions_bytes_swapped_out":0}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": true, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.009322643280029297, "jobTime": 4.049562931060791, "mode": "resolve", "mergeExceptionsInOrder": true}
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.353] [local execution engine] [info] Stopped local executor E/1
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.360] [local execution engine] [info] Stopped local executor E/2
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.366] [local execution engine] [info] Stopped local executor E/3
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.373] [local execution engine] [info] Stopped local executor E/4
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.379] [local execution engine] [info] Stopped local executor E/5
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.386] [local execution engine] [info] Stopped local executor E/6
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.392] [local execution engine] [info] Stopped local executor E/7
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.398] [local execution engine] [info] Stopped local executor E/8
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.405] [local execution engine] [info] Stopped local executor E/9
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.411] [local execution engine] [info] Stopped local executor E/10
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.417] [local execution engine] [info] Stopped local executor E/11
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.423] [local execution engine] [info] Stopped local executor E/12
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.430] [local execution engine] [info] Stopped local executor E/13
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.436] [local execution engine] [info] Stopped local executor E/14
[GLOBAL] releasing 20 active partitions
[2022-02-19 21:45:18.442] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 21 active partitions
