[2022-02-19 21:13:22.822] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.3.1-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2022-02-19 21:13:22.822] [local ee] [info] initializing LLVM backend
[2022-02-19 21:13:22.822] [local ee] [warning] init JIT compiler also only in local mode
[2022-02-19 21:13:22.823] [LLVM] [info] compiling code for skylake-avx512
[2022-02-19 21:13:22.823] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.823] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/1] [info] starting detached process queue
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/2] [info] starting detached process queue
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/1] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [E/2] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [E/3] [info] starting detached process queue
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/4] [info] starting detached process queue
[2022-02-19 21:13:22.824] [E/3] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [E/4] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/5] [info] starting detached process queue
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/6] [info] starting detached process queue
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/5] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [E/7] [info] starting detached process queue
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/6] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [E/7] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [E/8] [info] starting detached process queue
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/8] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [E/9] [info] starting detached process queue
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/10] [info] starting detached process queue
[2022-02-19 21:13:22.824] [E/9] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [E/10] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.824] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.824] [E/11] [info] starting detached process queue
[2022-02-19 21:13:22.825] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.825] [E/11] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.825] [E/12] [info] starting detached process queue
[2022-02-19 21:13:22.825] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.825] [E/12] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.825] [E/13] [info] starting detached process queue
[2022-02-19 21:13:22.825] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.825] [E/14] [info] starting detached process queue
[2022-02-19 21:13:22.825] [E/13] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.825] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.825] [E/14] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.825] [E/15] [info] starting detached process queue
[2022-02-19 21:13:22.825] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2022-02-19 21:13:22.825] [E/15] [info] initialized runtime memory (4.00 MB)
[2022-02-19 21:13:22.825] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
[2022-02-19 21:13:22.825] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2022-02-19 21:13:22.825] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2022-02-19 21:13:22.993] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:13:23.226] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:13:23.259] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:13:23.261] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:13:23.263] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:13:23.264] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:13:23.266] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:13:23.267] [global] [info] detected type for resolve operator is (i64)
[2022-02-19 21:13:23.285] [logical planner] [info] logical optimization took 0.023240ms
[2022-02-19 21:13:23.285] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2022-02-19 21:13:23.285] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2022-02-19 21:13:23.286] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2022-02-19 21:13:23.287] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2022-02-19 21:13:23.287] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2022-02-19 21:13:23.288] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2022-02-19 21:13:23.289] [codegen] [info] generating lambda function for (Option[str]) -> str
[2022-02-19 21:13:23.290] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2022-02-19 21:13:23.291] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2022-02-19 21:13:23.292] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2022-02-19 21:13:23.292] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2022-02-19 21:13:23.294] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-19 21:13:23.294] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-19 21:13:23.295] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2022-02-19 21:13:23.296] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2022-02-19 21:13:23.297] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2022-02-19 21:13:23.298] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2022-02-19 21:13:23.299] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2022-02-19 21:13:23.299] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2022-02-19 21:13:23.300] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2022-02-19 21:13:23.300] [codegen] [info] generating lambda function for (Option[str]) -> str
[2022-02-19 21:13:23.301] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2022-02-19 21:13:23.302] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2022-02-19 21:13:23.303] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2022-02-19 21:13:23.304] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2022-02-19 21:13:23.305] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2022-02-19 21:13:23.306] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-19 21:13:23.306] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-19 21:13:23.307] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2022-02-19 21:13:23.364] [global] [info] retrieved metrics object
[2022-02-19 21:13:23.695] [global] [info] Optimization via LLVM passes took 0.338090 ms
[2022-02-19 21:13:23.695] [global] [info] starting code compilation
[2022-02-19 21:13:23.695] [global] [info] first compile done
[2022-02-19 21:13:23.851] [global] [info] functor Stage_0 retrieved from llvm
[2022-02-19 21:13:23.851] [global] [info] retrieving init/release stage functors
[2022-02-19 21:13:23.851] [global] [info] Compiled code paths for stage 0 in 0.16 ms
[2022-02-19 21:13:23.851] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.511239s
[2022-02-19 21:13:23.851] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2022-02-19 21:13:24.131] [E/5] [info] [Task Finished] Transform to mem in 0.280167s (11005 normal rows, 42741 exceptions)
[2022-02-19 21:13:24.132] [driver] [info] [Task Finished] Transform to mem in 0.280214s (11005 normal rows, 42744 exceptions)
[2022-02-19 21:13:24.132] [E/8] [info] [Task Finished] Transform to mem in 0.280429s (11047 normal rows, 43210 exceptions)
[2022-02-19 21:13:24.132] [E/10] [info] [Task Finished] Transform to mem in 0.280653s (11036 normal rows, 43139 exceptions)
[2022-02-19 21:13:24.132] [E/9] [info] [Task Finished] Transform to mem in 0.280661s (11086 normal rows, 43015 exceptions)
[2022-02-19 21:13:24.132] [E/15] [info] [Task Finished] Transform to mem in 0.280807s (11026 normal rows, 43206 exceptions)
[2022-02-19 21:13:24.132] [E/12] [info] [Task Finished] Transform to mem in 0.280843s (11153 normal rows, 42968 exceptions)
[2022-02-19 21:13:24.132] [E/4] [info] [Task Finished] Transform to mem in 0.280946s (11036 normal rows, 43142 exceptions)
[2022-02-19 21:13:24.132] [E/3] [info] [Task Finished] Transform to mem in 0.280971s (11153 normal rows, 42970 exceptions)
[2022-02-19 21:13:24.132] [E/13] [info] [Task Finished] Transform to mem in 0.280997s (10997 normal rows, 42910 exceptions)
[2022-02-19 21:13:24.132] [E/1] [info] [Task Finished] Transform to mem in 0.281078s (11105 normal rows, 43095 exceptions)
[2022-02-19 21:13:24.132] [E/2] [info] [Task Finished] Transform to mem in 0.281135s (10997 normal rows, 42873 exceptions)
[2022-02-19 21:13:24.132] [E/11] [info] [Task Finished] Transform to mem in 0.281145s (11008 normal rows, 43077 exceptions)
[2022-02-19 21:13:24.133] [E/6] [info] [Task Finished] Transform to mem in 0.281219s (10987 normal rows, 43113 exceptions)
[2022-02-19 21:13:24.133] [E/7] [info] [Task Finished] Transform to mem in 0.281521s (11073 normal rows, 43414 exceptions)
[2022-02-19 21:13:24.133] [E/14] [info] [Task Finished] Transform to mem in 0.281745s (11092 normal rows, 43495 exceptions)
[2022-02-19 21:13:24.408] [E/5] [info] [Task Finished] Transform to mem in 0.275985s (11086 normal rows, 42996 exceptions)
[2022-02-19 21:13:24.408] [E/15] [info] [Task Finished] Transform to mem in 0.276209s (11023 normal rows, 42910 exceptions)
[2022-02-19 21:13:24.408] [E/8] [info] [Task Finished] Transform to mem in 0.276676s (11153 normal rows, 42978 exceptions)
[2022-02-19 21:13:24.409] [E/12] [info] [Task Finished] Transform to mem in 0.276381s (11036 normal rows, 43115 exceptions)
[2022-02-19 21:13:24.409] [E/10] [info] [Task Finished] Transform to mem in 0.276693s (11026 normal rows, 43205 exceptions)
[2022-02-19 21:13:24.409] [E/9] [info] [Task Finished] Transform to mem in 0.276696s (10982 normal rows, 43059 exceptions)
[2022-02-19 21:13:24.409] [driver] [info] [Task Finished] Transform to mem in 0.277162s (11092 normal rows, 43505 exceptions)
[2022-02-19 21:13:24.409] [E/4] [info] [Task Finished] Transform to mem in 0.276576s (11005 normal rows, 42772 exceptions)
[2022-02-19 21:13:24.409] [E/2] [info] [Task Finished] Transform to mem in 0.276420s (11076 normal rows, 43220 exceptions)
[2022-02-19 21:13:24.409] [E/6] [info] [Task Finished] Transform to mem in 0.276476s (11023 normal rows, 42880 exceptions)
[2022-02-19 21:13:24.409] [E/11] [info] [Task Finished] Transform to mem in 0.276769s (10987 normal rows, 43068 exceptions)
[2022-02-19 21:13:24.409] [E/13] [info] [Task Finished] Transform to mem in 0.277024s (11079 normal rows, 43539 exceptions)
[2022-02-19 21:13:24.409] [E/3] [info] [Task Finished] Transform to mem in 0.277117s (11086 normal rows, 42970 exceptions)
[2022-02-19 21:13:24.409] [E/7] [info] [Task Finished] Transform to mem in 0.276617s (11036 normal rows, 43053 exceptions)
[2022-02-19 21:13:24.410] [E/14] [info] [Task Finished] Transform to mem in 0.277243s (10992 normal rows, 42864 exceptions)
[2022-02-19 21:13:24.411] [E/1] [info] [Task Finished] Transform to mem in 0.278380s (11111 normal rows, 42961 exceptions)
[2022-02-19 21:13:24.683] [E/5] [info] [Task Finished] Transform to mem in 0.275900s (11099 normal rows, 42882 exceptions)
[2022-02-19 21:13:24.684] [E/9] [info] [Task Finished] Transform to mem in 0.275608s (11004 normal rows, 42876 exceptions)
[2022-02-19 21:13:24.684] [E/8] [info] [Task Finished] Transform to mem in 0.275887s (11127 normal rows, 42969 exceptions)
[2022-02-19 21:13:24.684] [E/2] [info] [Task Finished] Transform to mem in 0.275513s (11064 normal rows, 42832 exceptions)
[2022-02-19 21:13:24.684] [E/4] [info] [Task Finished] Transform to mem in 0.275547s (11021 normal rows, 42887 exceptions)
[2022-02-19 21:13:24.685] [E/15] [info] [Task Finished] Transform to mem in 0.276138s (11063 normal rows, 43617 exceptions)
[2022-02-19 21:13:24.685] [E/10] [info] [Task Finished] Transform to mem in 0.275847s (10987 normal rows, 43063 exceptions)
[2022-02-19 21:13:24.685] [E/7] [info] [Task Finished] Transform to mem in 0.275472s (11004 normal rows, 42913 exceptions)
[2022-02-19 21:13:24.685] [E/13] [info] [Task Finished] Transform to mem in 0.275688s (11076 normal rows, 43212 exceptions)
[2022-02-19 21:13:24.685] [E/12] [info] [Task Finished] Transform to mem in 0.276537s (11076 normal rows, 43221 exceptions)
[2022-02-19 21:13:24.685] [driver] [info] [Task Finished] Transform to mem in 0.276473s (11026 normal rows, 43041 exceptions)
[2022-02-19 21:13:24.685] [E/6] [info] [Task Finished] Transform to mem in 0.276242s (11098 normal rows, 43603 exceptions)
[2022-02-19 21:13:24.685] [E/11] [info] [Task Finished] Transform to mem in 0.276101s (11127 normal rows, 43028 exceptions)
[2022-02-19 21:13:24.686] [E/3] [info] [Task Finished] Transform to mem in 0.276370s (10987 normal rows, 43041 exceptions)
[2022-02-19 21:13:24.687] [E/1] [info] [Task Finished] Transform to mem in 0.275944s (11012 normal rows, 42883 exceptions)
[2022-02-19 21:13:24.687] [E/14] [info] [Task Finished] Transform to mem in 0.276785s (11026 normal rows, 43037 exceptions)
[2022-02-19 21:13:24.959] [E/5] [info] [Task Finished] Transform to mem in 0.275676s (11073 normal rows, 42820 exceptions)
[2022-02-19 21:13:24.960] [E/2] [info] [Task Finished] Transform to mem in 0.275879s (11076 normal rows, 43152 exceptions)
[2022-02-19 21:13:24.960] [E/9] [info] [Task Finished] Transform to mem in 0.275983s (11095 normal rows, 43503 exceptions)
[2022-02-19 21:13:24.960] [E/8] [info] [Task Finished] Transform to mem in 0.275993s (11130 normal rows, 43084 exceptions)
[2022-02-19 21:13:24.960] [E/7] [info] [Task Finished] Transform to mem in 0.275472s (11012 normal rows, 42888 exceptions)
[2022-02-19 21:13:24.961] [E/10] [info] [Task Finished] Transform to mem in 0.275992s (11026 normal rows, 43035 exceptions)
[2022-02-19 21:13:24.961] [E/4] [info] [Task Finished] Transform to mem in 0.276540s (10976 normal rows, 43110 exceptions)
[2022-02-19 21:13:24.961] [E/15] [info] [Task Finished] Transform to mem in 0.276535s (11015 normal rows, 42966 exceptions)
[2022-02-19 21:13:24.961] [E/6] [info] [Task Finished] Transform to mem in 0.275975s (11069 normal rows, 43142 exceptions)
[2022-02-19 21:13:24.962] [E/11] [info] [Task Finished] Transform to mem in 0.276171s (10974 normal rows, 43172 exceptions)
[2022-02-19 21:13:24.962] [driver] [info] [Task Finished] Transform to mem in 0.276737s (11130 normal rows, 43033 exceptions)
[2022-02-19 21:13:24.962] [E/12] [info] [Task Finished] Transform to mem in 0.276965s (11095 normal rows, 43552 exceptions)
[2022-02-19 21:13:24.962] [E/3] [info] [Task Finished] Transform to mem in 0.276602s (11008 normal rows, 42964 exceptions)
[2022-02-19 21:13:24.964] [E/13] [info] [Task Finished] Transform to mem in 0.278474s (11073 normal rows, 42754 exceptions)
[2022-02-19 21:13:24.964] [E/1] [info] [Task Finished] Transform to mem in 0.277052s (11042 normal rows, 43023 exceptions)
[2022-02-19 21:13:24.964] [E/14] [info] [Task Finished] Transform to mem in 0.276703s (11012 normal rows, 42911 exceptions)
[2022-02-19 21:13:25.235] [E/5] [info] [Task Finished] Transform to mem in 0.275411s (11063 normal rows, 42726 exceptions)
[2022-02-19 21:13:25.236] [E/8] [info] [Task Finished] Transform to mem in 0.275539s (11087 normal rows, 43150 exceptions)
[2022-02-19 21:13:25.236] [E/9] [info] [Task Finished] Transform to mem in 0.275850s (11081 normal rows, 43050 exceptions)
[2022-02-19 21:13:25.236] [E/4] [info] [Task Finished] Transform to mem in 0.275480s (11042 normal rows, 42959 exceptions)
[2022-02-19 21:13:25.237] [E/6] [info] [Task Finished] Transform to mem in 0.275306s (11073 normal rows, 42720 exceptions)
[2022-02-19 21:13:25.237] [E/10] [info] [Task Finished] Transform to mem in 0.276048s (11008 normal rows, 42975 exceptions)
[2022-02-19 21:13:25.237] [E/7] [info] [Task Finished] Transform to mem in 0.276257s (11005 normal rows, 43164 exceptions)
[2022-02-19 21:13:25.237] [E/2] [info] [Task Finished] Transform to mem in 0.276398s (11105 normal rows, 43555 exceptions)
[2022-02-19 21:13:25.237] [E/15] [info] [Task Finished] Transform to mem in 0.275751s (11002 normal rows, 42964 exceptions)
[2022-02-19 21:13:25.238] [E/11] [info] [Task Finished] Transform to mem in 0.276199s (11088 normal rows, 43511 exceptions)
[2022-02-19 21:13:25.238] [E/12] [info] [Task Finished] Transform to mem in 0.275839s (11087 normal rows, 43044 exceptions)
[2022-02-19 21:13:25.239] [driver] [info] [Task Finished] Transform to mem in 0.276931s (11098 normal rows, 43112 exceptions)
[2022-02-19 21:13:25.239] [E/3] [info] [Task Finished] Transform to mem in 0.276825s (11005 normal rows, 43229 exceptions)
[2022-02-19 21:13:25.239] [E/1] [info] [Task Finished] Transform to mem in 0.275557s (11024 normal rows, 42947 exceptions)
[2022-02-19 21:13:25.240] [E/13] [info] [Task Finished] Transform to mem in 0.276008s (11008 normal rows, 43017 exceptions)
[2022-02-19 21:13:25.241] [E/14] [info] [Task Finished] Transform to mem in 0.276827s (11020 normal rows, 42976 exceptions)
[2022-02-19 21:13:25.510] [E/5] [info] [Task Finished] Transform to mem in 0.275636s (11036 normal rows, 42710 exceptions)
[2022-02-19 21:13:25.512] [E/15] [info] [Task Finished] Transform to mem in 0.275308s (10995 normal rows, 42708 exceptions)
[2022-02-19 21:13:25.512] [E/8] [info] [Task Finished] Transform to mem in 0.276283s (11125 normal rows, 43517 exceptions)
[2022-02-19 21:13:25.512] [E/7] [info] [Task Finished] Transform to mem in 0.275647s (11052 normal rows, 42881 exceptions)
[2022-02-19 21:13:25.512] [E/9] [info] [Task Finished] Transform to mem in 0.276217s (11098 normal rows, 43115 exceptions)
[2022-02-19 21:13:25.513] [E/4] [info] [Task Finished] Transform to mem in 0.276018s (11087 normal rows, 42938 exceptions)
[2022-02-19 21:13:25.513] [E/10] [info] [Task Finished] Transform to mem in 0.276204s (11000 normal rows, 42999 exceptions)
[2022-02-19 21:13:25.513] [E/6] [info] [Task Finished] Transform to mem in 0.276265s (10985 normal rows, 43336 exceptions)
[2022-02-19 21:13:25.514] [E/2] [info] [Task Finished] Transform to mem in 0.276923s (11020 normal rows, 43057 exceptions)
[2022-02-19 21:13:25.514] [E/12] [info] [Task Finished] Transform to mem in 0.276150s (11098 normal rows, 43075 exceptions)
[2022-02-19 21:13:25.514] [E/11] [info] [Task Finished] Transform to mem in 0.276451s (11166 normal rows, 43520 exceptions)
[2022-02-19 21:13:25.515] [E/1] [info] [Task Finished] Transform to mem in 0.276004s (11000 normal rows, 43009 exceptions)
[2022-02-19 21:13:25.516] [E/3] [info] [Task Finished] Transform to mem in 0.276456s (10999 normal rows, 43334 exceptions)
[2022-02-19 21:13:25.516] [E/13] [info] [Task Finished] Transform to mem in 0.276446s (11052 normal rows, 42764 exceptions)
[2022-02-19 21:13:25.517] [driver] [info] [Task Finished] Transform to mem in 0.278004s (11073 normal rows, 42970 exceptions)
[2022-02-19 21:13:25.518] [E/14] [info] [Task Finished] Transform to mem in 0.277618s (11020 normal rows, 43138 exceptions)
[2022-02-19 21:13:25.785] [E/5] [info] [Task Finished] Transform to mem in 0.275168s (10995 normal rows, 42726 exceptions)
[2022-02-19 21:13:25.788] [E/8] [info] [Task Finished] Transform to mem in 0.275729s (11091 normal rows, 43047 exceptions)
[2022-02-19 21:13:25.788] [E/15] [info] [Task Finished] Transform to mem in 0.275812s (11166 normal rows, 43508 exceptions)
[2022-02-19 21:13:25.788] [E/7] [info] [Task Finished] Transform to mem in 0.275716s (11080 normal rows, 43031 exceptions)
[2022-02-19 21:13:25.788] [E/9] [info] [Task Finished] Transform to mem in 0.275777s (10999 normal rows, 43300 exceptions)
[2022-02-19 21:13:25.789] [E/10] [info] [Task Finished] Transform to mem in 0.275734s (11036 normal rows, 42720 exceptions)
[2022-02-19 21:13:25.789] [E/4] [info] [Task Finished] Transform to mem in 0.276306s (11000 normal rows, 43043 exceptions)
[2022-02-19 21:13:25.789] [E/6] [info] [Task Finished] Transform to mem in 0.275981s (11016 normal rows, 43165 exceptions)
[2022-02-19 21:13:25.789] [E/2] [info] [Task Finished] Transform to mem in 0.275601s (10995 normal rows, 42718 exceptions)
[2022-02-19 21:13:25.790] [E/11] [info] [Task Finished] Transform to mem in 0.276044s (11001 normal rows, 43113 exceptions)
[2022-02-19 21:13:25.790] [E/12] [info] [Task Finished] Transform to mem in 0.276357s (11186 normal rows, 43465 exceptions)
[2022-02-19 21:13:25.791] [E/1] [info] [Task Finished] Transform to mem in 0.276026s (11170 normal rows, 43024 exceptions)
[2022-02-19 21:13:25.792] [E/3] [info] [Task Finished] Transform to mem in 0.275928s (10989 normal rows, 43282 exceptions)
[2022-02-19 21:13:25.792] [E/13] [info] [Task Finished] Transform to mem in 0.276129s (11010 normal rows, 43002 exceptions)
[2022-02-19 21:13:25.794] [driver] [info] [Task Finished] Transform to mem in 0.277427s (11002 normal rows, 42755 exceptions)
[2022-02-19 21:13:25.796] [E/14] [info] [Task Finished] Transform to mem in 0.277352s (11050 normal rows, 43199 exceptions)
[2022-02-19 21:13:26.061] [E/5] [info] [Task Finished] Transform to mem in 0.275275s (10973 normal rows, 42686 exceptions)
[2022-02-19 21:13:26.063] [E/15] [info] [Task Finished] Transform to mem in 0.275414s (11045 normal rows, 43148 exceptions)
[2022-02-19 21:13:26.064] [E/7] [info] [Task Finished] Transform to mem in 0.275531s (11166 normal rows, 43023 exceptions)
[2022-02-19 21:13:26.064] [E/8] [info] [Task Finished] Transform to mem in 0.275784s (11160 normal rows, 43455 exceptions)
[2022-02-19 21:13:26.064] [E/9] [info] [Task Finished] Transform to mem in 0.275716s (10997 normal rows, 43283 exceptions)
[2022-02-19 21:13:26.064] [E/4] [info] [Task Finished] Transform to mem in 0.275215s (11007 normal rows, 42795 exceptions)
[2022-02-19 21:13:26.064] [E/10] [info] [Task Finished] Transform to mem in 0.275650s (11005 normal rows, 42971 exceptions)
[2022-02-19 21:13:26.065] [E/6] [info] [Task Finished] Transform to mem in 0.275909s (11050 normal rows, 43196 exceptions)
[2022-02-19 21:13:26.065] [E/2] [info] [Task Finished] Transform to mem in 0.275588s (10973 normal rows, 42686 exceptions)
[2022-02-19 21:13:26.066] [E/12] [info] [Task Finished] Transform to mem in 0.275704s (11043 normal rows, 43153 exceptions)
[2022-02-19 21:13:26.067] [E/11] [info] [Task Finished] Transform to mem in 0.276415s (11160 normal rows, 43446 exceptions)
[2022-02-19 21:13:26.067] [E/3] [info] [Task Finished] Transform to mem in 0.275300s (10997 normal rows, 43277 exceptions)
[2022-02-19 21:13:26.067] [E/1] [info] [Task Finished] Transform to mem in 0.275563s (11168 normal rows, 43028 exceptions)
[2022-02-19 21:13:26.068] [E/13] [info] [Task Finished] Transform to mem in 0.275656s (10997 normal rows, 42973 exceptions)
[2022-02-19 21:13:26.072] [driver] [info] [Task Finished] Transform to mem in 0.277779s (11015 normal rows, 42799 exceptions)
[2022-02-19 21:13:26.072] [E/14] [info] [Task Finished] Transform to mem in 0.276490s (11050 normal rows, 43170 exceptions)
[2022-02-19 21:13:26.336] [E/5] [info] [Task Finished] Transform to mem in 0.275176s (10973 normal rows, 42710 exceptions)
[2022-02-19 21:13:26.339] [E/7] [info] [Task Finished] Transform to mem in 0.275509s (11043 normal rows, 43166 exceptions)
[2022-02-19 21:13:26.339] [E/15] [info] [Task Finished] Transform to mem in 0.275879s (11160 normal rows, 43431 exceptions)
[2022-02-19 21:13:26.340] [E/10] [info] [Task Finished] Transform to mem in 0.275241s (11009 normal rows, 42805 exceptions)
[2022-02-19 21:13:26.340] [E/8] [info] [Task Finished] Transform to mem in 0.275775s (11168 normal rows, 43027 exceptions)
[2022-02-19 21:13:26.340] [E/9] [info] [Task Finished] Transform to mem in 0.275646s (10997 normal rows, 43237 exceptions)
[2022-02-19 21:13:26.340] [E/4] [info] [Task Finished] Transform to mem in 0.276137s (10997 normal rows, 43012 exceptions)
[2022-02-19 21:13:26.341] [E/2] [info] [Task Finished] Transform to mem in 0.275658s (11003 normal rows, 42716 exceptions)
[2022-02-19 21:13:26.341] [E/6] [info] [Task Finished] Transform to mem in 0.275868s (11021 normal rows, 43160 exceptions)
[2022-02-19 21:13:26.342] [E/12] [info] [Task Finished] Transform to mem in 0.276041s (11165 normal rows, 43354 exceptions)
[2022-02-19 21:13:26.343] [E/11] [info] [Task Finished] Transform to mem in 0.275826s (11043 normal rows, 43217 exceptions)
[2022-02-19 21:13:26.343] [E/1] [info] [Task Finished] Transform to mem in 0.275593s (11009 normal rows, 43187 exceptions)
[2022-02-19 21:13:26.343] [E/3] [info] [Task Finished] Transform to mem in 0.275734s (11156 normal rows, 43044 exceptions)
[2022-02-19 21:13:26.344] [E/13] [info] [Task Finished] Transform to mem in 0.275927s (10997 normal rows, 43067 exceptions)
[2022-02-19 21:13:26.349] [E/14] [info] [Task Finished] Transform to mem in 0.276455s (11021 normal rows, 43162 exceptions)
[2022-02-19 21:13:26.349] [driver] [info] [Task Finished] Transform to mem in 0.276980s (11009 normal rows, 42811 exceptions)
[2022-02-19 21:13:26.614] [E/5] [info] [Task Finished] Transform to mem in 0.278284s (11003 normal rows, 42716 exceptions)
[2022-02-19 21:13:26.618] [E/7] [info] [Task Finished] Transform to mem in 0.278360s (11165 normal rows, 43260 exceptions)
[2022-02-19 21:13:26.618] [E/15] [info] [Task Finished] Transform to mem in 0.278422s (11027 normal rows, 43245 exceptions)
[2022-02-19 21:13:26.618] [E/8] [info] [Task Finished] Transform to mem in 0.278281s (10997 normal rows, 43177 exceptions)
[2022-02-19 21:13:26.618] [E/9] [info] [Task Finished] Transform to mem in 0.278827s (11009 normal rows, 43050 exceptions)
[2022-02-19 21:13:26.619] [E/10] [info] [Task Finished] Transform to mem in 0.278947s (11172 normal rows, 43107 exceptions)
[2022-02-19 21:13:26.619] [E/4] [info] [Task Finished] Transform to mem in 0.278604s (10999 normal rows, 42828 exceptions)
[2022-02-19 21:13:26.619] [E/6] [info] [Task Finished] Transform to mem in 0.278283s (11000 normal rows, 42726 exceptions)
[2022-02-19 21:13:26.620] [E/2] [info] [Task Finished] Transform to mem in 0.279119s (11031 normal rows, 43157 exceptions)
[2022-02-19 21:13:26.621] [E/12] [info] [Task Finished] Transform to mem in 0.278746s (11091 normal rows, 43230 exceptions)
[2022-02-19 21:13:26.621] [E/3] [info] [Task Finished] Transform to mem in 0.278467s (10997 normal rows, 43174 exceptions)
[2022-02-19 21:13:26.622] [E/1] [info] [Task Finished] Transform to mem in 0.278856s (11177 normal rows, 43113 exceptions)
[2022-02-19 21:13:26.622] [E/11] [info] [Task Finished] Transform to mem in 0.278993s (11099 normal rows, 43272 exceptions)
[2022-02-19 21:13:26.622] [E/13] [info] [Task Finished] Transform to mem in 0.278672s (10987 normal rows, 43020 exceptions)
[2022-02-19 21:13:26.628] [E/14] [info] [Task Finished] Transform to mem in 0.279332s (11020 normal rows, 42867 exceptions)
[2022-02-19 21:13:26.662] [driver] [info] [Task Finished] Transform to mem in 0.312749s (12330 normal rows, 48094 exceptions)
[2022-02-19 21:13:26.662] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.81128s
[2022-02-19 21:13:26.662] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.3361s, 56350770 input rows, time to process 1 row via fast path: 0.000786787ms
[2022-02-19 21:13:26.662] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2022-02-19 21:13:26.667] [local ee] [info] compiled pure python pipeline in 0.004379s
[2022-02-19 21:13:26.667] [local ee] [info] creating hybrid intermediates took 0.000003s
[2022-02-19 21:13:26.668] [local ee] [info] Created 160 resolve tasks in 0.001309s
[2022-02-19 21:13:26.668] [local ee] [info] 160/160 tasks require executing the slow path.
[2022-02-19 21:13:26.681] [E/9] [info] [Task Finished] Resolve in 0.012711s
[2022-02-19 21:13:26.681] [E/12] [info] [Task Finished] Resolve in 0.012790s
[2022-02-19 21:13:26.681] [E/3] [info] [Task Finished] Resolve in 0.012792s
[2022-02-19 21:13:26.681] [driver] [info] [Task Finished] Resolve in 0.012819s
[2022-02-19 21:13:26.681] [E/13] [info] [Task Finished] Resolve in 0.012867s
[2022-02-19 21:13:26.681] [E/4] [info] [Task Finished] Resolve in 0.012901s
[2022-02-19 21:13:26.681] [E/1] [info] [Task Finished] Resolve in 0.012916s
[2022-02-19 21:13:26.681] [E/5] [info] [Task Finished] Resolve in 0.012947s
[2022-02-19 21:13:26.681] [E/11] [info] [Task Finished] Resolve in 0.012984s
[2022-02-19 21:13:26.681] [E/6] [info] [Task Finished] Resolve in 0.013000s
[2022-02-19 21:13:26.681] [E/15] [info] [Task Finished] Resolve in 0.013008s
[2022-02-19 21:13:26.681] [E/7] [info] [Task Finished] Resolve in 0.013027s
[2022-02-19 21:13:26.681] [E/8] [info] [Task Finished] Resolve in 0.013045s
[2022-02-19 21:13:26.681] [E/2] [info] [Task Finished] Resolve in 0.013030s
[2022-02-19 21:13:26.681] [E/10] [info] [Task Finished] Resolve in 0.013007s
[2022-02-19 21:13:26.681] [E/14] [info] [Task Finished] Resolve in 0.013061s
[2022-02-19 21:13:26.693] [E/9] [info] [Task Finished] Resolve in 0.012398s
[2022-02-19 21:13:26.693] [E/5] [info] [Task Finished] Resolve in 0.012295s
[2022-02-19 21:13:26.693] [E/12] [info] [Task Finished] Resolve in 0.012478s
[2022-02-19 21:13:26.693] [E/3] [info] [Task Finished] Resolve in 0.012492s
[2022-02-19 21:13:26.693] [driver] [info] [Task Finished] Resolve in 0.012494s
[2022-02-19 21:13:26.693] [E/4] [info] [Task Finished] Resolve in 0.012433s
[2022-02-19 21:13:26.693] [E/6] [info] [Task Finished] Resolve in 0.012340s
[2022-02-19 21:13:26.693] [E/11] [info] [Task Finished] Resolve in 0.012388s
[2022-02-19 21:13:26.693] [E/13] [info] [Task Finished] Resolve in 0.012514s
[2022-02-19 21:13:26.693] [E/15] [info] [Task Finished] Resolve in 0.012393s
[2022-02-19 21:13:26.693] [E/10] [info] [Task Finished] Resolve in 0.012322s
[2022-02-19 21:13:26.693] [E/14] [info] [Task Finished] Resolve in 0.012346s
[2022-02-19 21:13:26.693] [E/1] [info] [Task Finished] Resolve in 0.012569s
[2022-02-19 21:13:26.693] [E/8] [info] [Task Finished] Resolve in 0.012469s
[2022-02-19 21:13:26.694] [E/7] [info] [Task Finished] Resolve in 0.012545s
[2022-02-19 21:13:26.694] [E/2] [info] [Task Finished] Resolve in 0.012596s
[2022-02-19 21:13:26.706] [E/9] [info] [Task Finished] Resolve in 0.012432s
[2022-02-19 21:13:26.706] [E/5] [info] [Task Finished] Resolve in 0.012320s
[2022-02-19 21:13:26.706] [E/12] [info] [Task Finished] Resolve in 0.012297s
[2022-02-19 21:13:26.706] [driver] [info] [Task Finished] Resolve in 0.012302s
[2022-02-19 21:13:26.706] [E/3] [info] [Task Finished] Resolve in 0.012325s
[2022-02-19 21:13:26.706] [E/6] [info] [Task Finished] Resolve in 0.012353s
[2022-02-19 21:13:26.706] [E/11] [info] [Task Finished] Resolve in 0.012339s
[2022-02-19 21:13:26.706] [E/13] [info] [Task Finished] Resolve in 0.012352s
[2022-02-19 21:13:26.706] [E/15] [info] [Task Finished] Resolve in 0.012333s
[2022-02-19 21:13:26.706] [E/10] [info] [Task Finished] Resolve in 0.012376s
[2022-02-19 21:13:26.706] [E/1] [info] [Task Finished] Resolve in 0.012330s
[2022-02-19 21:13:26.706] [E/7] [info] [Task Finished] Resolve in 0.012306s
[2022-02-19 21:13:26.706] [E/8] [info] [Task Finished] Resolve in 0.012417s
[2022-02-19 21:13:26.706] [E/4] [info] [Task Finished] Resolve in 0.012614s
[2022-02-19 21:13:26.706] [E/14] [info] [Task Finished] Resolve in 0.012581s
[2022-02-19 21:13:26.706] [E/2] [info] [Task Finished] Resolve in 0.012386s
[2022-02-19 21:13:26.718] [E/9] [info] [Task Finished] Resolve in 0.012371s
[2022-02-19 21:13:26.718] [E/5] [info] [Task Finished] Resolve in 0.012425s
[2022-02-19 21:13:26.718] [driver] [info] [Task Finished] Resolve in 0.012370s
[2022-02-19 21:13:26.718] [E/3] [info] [Task Finished] Resolve in 0.012384s
[2022-02-19 21:13:26.718] [E/13] [info] [Task Finished] Resolve in 0.012453s
[2022-02-19 21:13:26.718] [E/1] [info] [Task Finished] Resolve in 0.012407s
[2022-02-19 21:13:26.718] [E/12] [info] [Task Finished] Resolve in 0.012660s
[2022-02-19 21:13:26.718] [E/6] [info] [Task Finished] Resolve in 0.012560s
[2022-02-19 21:13:26.718] [E/15] [info] [Task Finished] Resolve in 0.012543s
[2022-02-19 21:13:26.718] [E/10] [info] [Task Finished] Resolve in 0.012518s
[2022-02-19 21:13:26.718] [E/11] [info] [Task Finished] Resolve in 0.012650s
[2022-02-19 21:13:26.718] [E/4] [info] [Task Finished] Resolve in 0.012445s
[2022-02-19 21:13:26.718] [E/8] [info] [Task Finished] Resolve in 0.012536s
[2022-02-19 21:13:26.719] [E/2] [info] [Task Finished] Resolve in 0.012460s
[2022-02-19 21:13:26.719] [E/14] [info] [Task Finished] Resolve in 0.012563s
[2022-02-19 21:13:26.719] [E/7] [info] [Task Finished] Resolve in 0.012755s
[2022-02-19 21:13:26.730] [E/9] [info] [Task Finished] Resolve in 0.012394s
[2022-02-19 21:13:26.730] [driver] [info] [Task Finished] Resolve in 0.012413s
[2022-02-19 21:13:26.731] [E/3] [info] [Task Finished] Resolve in 0.012487s
[2022-02-19 21:13:26.731] [E/5] [info] [Task Finished] Resolve in 0.012531s
[2022-02-19 21:13:26.731] [E/13] [info] [Task Finished] Resolve in 0.012406s
[2022-02-19 21:13:26.731] [E/15] [info] [Task Finished] Resolve in 0.012373s
[2022-02-19 21:13:26.731] [E/12] [info] [Task Finished] Resolve in 0.012502s
[2022-02-19 21:13:26.731] [E/1] [info] [Task Finished] Resolve in 0.012521s
[2022-02-19 21:13:26.731] [E/11] [info] [Task Finished] Resolve in 0.012411s
[2022-02-19 21:13:26.731] [E/4] [info] [Task Finished] Resolve in 0.012441s
[2022-02-19 21:13:26.731] [E/2] [info] [Task Finished] Resolve in 0.012407s
[2022-02-19 21:13:26.731] [E/6] [info] [Task Finished] Resolve in 0.012666s
[2022-02-19 21:13:26.731] [E/8] [info] [Task Finished] Resolve in 0.012494s
[2022-02-19 21:13:26.731] [E/10] [info] [Task Finished] Resolve in 0.012653s
[2022-02-19 21:13:26.731] [E/14] [info] [Task Finished] Resolve in 0.012383s
[2022-02-19 21:13:26.731] [E/7] [info] [Task Finished] Resolve in 0.012333s
[2022-02-19 21:13:26.743] [E/9] [info] [Task Finished] Resolve in 0.012311s
[2022-02-19 21:13:26.743] [driver] [info] [Task Finished] Resolve in 0.012310s
[2022-02-19 21:13:26.743] [E/5] [info] [Task Finished] Resolve in 0.012350s
[2022-02-19 21:13:26.743] [E/13] [info] [Task Finished] Resolve in 0.012370s
[2022-02-19 21:13:26.743] [E/15] [info] [Task Finished] Resolve in 0.012358s
[2022-02-19 21:13:26.743] [E/12] [info] [Task Finished] Resolve in 0.012414s
[2022-02-19 21:13:26.743] [E/3] [info] [Task Finished] Resolve in 0.012668s
[2022-02-19 21:13:26.743] [E/11] [info] [Task Finished] Resolve in 0.012425s
[2022-02-19 21:13:26.743] [E/1] [info] [Task Finished] Resolve in 0.012488s
[2022-02-19 21:13:26.743] [E/4] [info] [Task Finished] Resolve in 0.012481s
[2022-02-19 21:13:26.743] [E/10] [info] [Task Finished] Resolve in 0.012350s
[2022-02-19 21:13:26.743] [E/6] [info] [Task Finished] Resolve in 0.012449s
[2022-02-19 21:13:26.743] [E/14] [info] [Task Finished] Resolve in 0.012426s
[2022-02-19 21:13:26.744] [E/7] [info] [Task Finished] Resolve in 0.012489s
[2022-02-19 21:13:26.744] [E/8] [info] [Task Finished] Resolve in 0.012574s
[2022-02-19 21:13:26.744] [E/2] [info] [Task Finished] Resolve in 0.012721s
[2022-02-19 21:13:26.755] [E/9] [info] [Task Finished] Resolve in 0.012360s
[2022-02-19 21:13:26.755] [driver] [info] [Task Finished] Resolve in 0.012389s
[2022-02-19 21:13:26.755] [E/13] [info] [Task Finished] Resolve in 0.012430s
[2022-02-19 21:13:26.756] [E/12] [info] [Task Finished] Resolve in 0.012354s
[2022-02-19 21:13:26.756] [E/15] [info] [Task Finished] Resolve in 0.012479s
[2022-02-19 21:13:26.756] [E/5] [info] [Task Finished] Resolve in 0.012641s
[2022-02-19 21:13:26.756] [E/1] [info] [Task Finished] Resolve in 0.012311s
[2022-02-19 21:13:26.756] [E/3] [info] [Task Finished] Resolve in 0.012454s
[2022-02-19 21:13:26.756] [E/11] [info] [Task Finished] Resolve in 0.012447s
[2022-02-19 21:13:26.756] [E/6] [info] [Task Finished] Resolve in 0.012347s
[2022-02-19 21:13:26.756] [E/4] [info] [Task Finished] Resolve in 0.012465s
[2022-02-19 21:13:26.756] [E/7] [info] [Task Finished] Resolve in 0.012365s
[2022-02-19 21:13:26.756] [E/8] [info] [Task Finished] Resolve in 0.012345s
[2022-02-19 21:13:26.756] [E/10] [info] [Task Finished] Resolve in 0.012597s
[2022-02-19 21:13:26.756] [E/14] [info] [Task Finished] Resolve in 0.012562s
[2022-02-19 21:13:26.756] [E/2] [info] [Task Finished] Resolve in 0.012431s
[2022-02-19 21:13:26.767] [E/9] [info] [Task Finished] Resolve in 0.012237s
[2022-02-19 21:13:26.767] [driver] [info] [Task Finished] Resolve in 0.012289s
[2022-02-19 21:13:26.768] [E/13] [info] [Task Finished] Resolve in 0.012367s
[2022-02-19 21:13:26.768] [E/5] [info] [Task Finished] Resolve in 0.012346s
[2022-02-19 21:13:26.768] [E/1] [info] [Task Finished] Resolve in 0.012394s
[2022-02-19 21:13:26.768] [E/11] [info] [Task Finished] Resolve in 0.012324s
[2022-02-19 21:13:26.768] [E/15] [info] [Task Finished] Resolve in 0.012475s
[2022-02-19 21:13:26.768] [E/6] [info] [Task Finished] Resolve in 0.012429s
[2022-02-19 21:13:26.768] [E/3] [info] [Task Finished] Resolve in 0.012524s
[2022-02-19 21:13:26.768] [E/12] [info] [Task Finished] Resolve in 0.012712s
[2022-02-19 21:13:26.768] [E/8] [info] [Task Finished] Resolve in 0.012482s
[2022-02-19 21:13:26.768] [E/10] [info] [Task Finished] Resolve in 0.012455s
[2022-02-19 21:13:26.768] [E/7] [info] [Task Finished] Resolve in 0.012552s
[2022-02-19 21:13:26.769] [E/14] [info] [Task Finished] Resolve in 0.012472s
[2022-02-19 21:13:26.769] [E/4] [info] [Task Finished] Resolve in 0.012805s
[2022-02-19 21:13:26.769] [E/2] [info] [Task Finished] Resolve in 0.012587s
[2022-02-19 21:13:26.780] [E/9] [info] [Task Finished] Resolve in 0.012449s
[2022-02-19 21:13:26.780] [driver] [info] [Task Finished] Resolve in 0.012997s
[2022-02-19 21:13:26.781] [E/15] [info] [Task Finished] Resolve in 0.012468s
[2022-02-19 21:13:26.781] [E/5] [info] [Task Finished] Resolve in 0.012808s
[2022-02-19 21:13:26.781] [E/1] [info] [Task Finished] Resolve in 0.012772s
[2022-02-19 21:13:26.781] [E/13] [info] [Task Finished] Resolve in 0.013036s
[2022-02-19 21:13:26.781] [E/6] [info] [Task Finished] Resolve in 0.012680s
[2022-02-19 21:13:26.781] [E/12] [info] [Task Finished] Resolve in 0.012636s
[2022-02-19 21:13:26.781] [E/11] [info] [Task Finished] Resolve in 0.012920s
[2022-02-19 21:13:26.781] [E/3] [info] [Task Finished] Resolve in 0.012830s
[2022-02-19 21:13:26.781] [E/7] [info] [Task Finished] Resolve in 0.012743s
[2022-02-19 21:13:26.781] [E/8] [info] [Task Finished] Resolve in 0.012798s
[2022-02-19 21:13:26.781] [E/10] [info] [Task Finished] Resolve in 0.012796s
[2022-02-19 21:13:26.781] [E/14] [info] [Task Finished] Resolve in 0.012761s
[2022-02-19 21:13:26.781] [E/4] [info] [Task Finished] Resolve in 0.012791s
[2022-02-19 21:13:26.782] [E/2] [info] [Task Finished] Resolve in 0.012950s
[2022-02-19 21:13:26.792] [E/9] [info] [Task Finished] Resolve in 0.012255s
[2022-02-19 21:13:26.793] [E/15] [info] [Task Finished] Resolve in 0.012387s
[2022-02-19 21:13:26.793] [driver] [info] [Task Finished] Resolve in 0.012472s
[2022-02-19 21:13:26.793] [E/5] [info] [Task Finished] Resolve in 0.012366s
[2022-02-19 21:13:26.793] [E/1] [info] [Task Finished] Resolve in 0.012363s
[2022-02-19 21:13:26.793] [E/12] [info] [Task Finished] Resolve in 0.012247s
[2022-02-19 21:13:26.793] [E/6] [info] [Task Finished] Resolve in 0.012294s
[2022-02-19 21:13:26.793] [E/13] [info] [Task Finished] Resolve in 0.012329s
[2022-02-19 21:13:26.793] [E/11] [info] [Task Finished] Resolve in 0.012392s
[2022-02-19 21:13:26.794] [E/3] [info] [Task Finished] Resolve in 0.012505s
[2022-02-19 21:13:26.794] [E/7] [info] [Task Finished] Resolve in 0.012367s
[2022-02-19 21:13:26.794] [E/8] [info] [Task Finished] Resolve in 0.012374s
[2022-02-19 21:13:26.794] [E/14] [info] [Task Finished] Resolve in 0.012311s
[2022-02-19 21:13:26.794] [E/10] [info] [Task Finished] Resolve in 0.012403s
[2022-02-19 21:13:26.794] [E/4] [info] [Task Finished] Resolve in 0.012364s
[2022-02-19 21:13:26.795] [E/2] [info] [Task Finished] Resolve in 0.013792s
[2022-02-19 21:13:26.796] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.133503s
[2022-02-19 21:13:26.796] [local ee] [info] slow path for Stage 0: total wall clock time: 2.00482s, time to process 1 row via slow path: 0.000290726ms
[2022-02-19 21:13:26.796] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.133529s

[2022-02-19 21:13:26.796] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2022-02-19 21:13:26.807] [driver] [info] [Task Finished] write to file in 0.010954s (46082 rows, 7.02 MB)
[2022-02-19 21:13:26.822] [E/2] [info] [Task Finished] write to file in 0.025729s (112467 rows, 17.12 MB)
[2022-02-19 21:13:26.822] [E/7] [info] [Task Finished] write to file in 0.025841s (112421 rows, 17.11 MB)
[2022-02-19 21:13:26.822] [E/13] [info] [Task Finished] write to file in 0.026073s (112573 rows, 17.14 MB)
[2022-02-19 21:13:26.822] [E/4] [info] [Task Finished] write to file in 0.026098s (112482 rows, 17.12 MB)
[2022-02-19 21:13:26.822] [E/15] [info] [Task Finished] write to file in 0.026161s (112583 rows, 17.14 MB)
[2022-02-19 21:13:26.822] [E/8] [info] [Task Finished] write to file in 0.026321s (112438 rows, 17.12 MB)
[2022-02-19 21:13:26.823] [E/14] [info] [Task Finished] write to file in 0.026351s (112459 rows, 17.12 MB)
[2022-02-19 21:13:26.823] [E/9] [info] [Task Finished] write to file in 0.026450s (112425 rows, 17.11 MB)
[2022-02-19 21:13:26.824] [E/5] [info] [Task Finished] write to file in 0.027538s (123424 rows, 18.79 MB)
[2022-02-19 21:13:26.824] [E/11] [info] [Task Finished] write to file in 0.027606s (123251 rows, 18.76 MB)
[2022-02-19 21:13:26.824] [E/12] [info] [Task Finished] write to file in 0.027609s (123410 rows, 18.79 MB)
[2022-02-19 21:13:26.824] [E/6] [info] [Task Finished] write to file in 0.027665s (123377 rows, 18.78 MB)
[2022-02-19 21:13:26.824] [E/3] [info] [Task Finished] write to file in 0.027702s (123389 rows, 18.78 MB)
[2022-02-19 21:13:26.824] [E/10] [info] [Task Finished] write to file in 0.027827s (123299 rows, 18.77 MB)
[2022-02-19 21:13:26.828] [E/1] [info] [Task Finished] write to file in 0.031658s (112411 rows, 17.11 MB)
[2022-02-19 21:13:26.828] [global] [info] writing output took 0.032202s
[2022-02-19 21:13:26.828] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0323s
[2022-02-19 21:13:26.828] [global] [info] [Transform Stage] Stage 0 took 3.48861s
[2022-02-19 21:13:26.828] [global] [info] Query Execution took 3.57022s. (planning: 0.081582s, execution: 3.48864s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.3.1
            |_|
    
using Python 3.6.9 (default, Feb  8 2022, 16:30:43) 
[GCC 9.3.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.009301424026489258
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 4.004438638687134 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.optimizer.mergeExceptionsInOrder': False, 'tuplex.optimizer.operatorReordering': False, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.network.verifySSL': False, 'tuplex.redirectToPythonLogging': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.optionalThreshold': 0.7, 'tuplex.aws.connectTimeout': '1', 'tuplex.aws.httpThreadCount': '32', 'tuplex.aws.lambdaMemory': '1536', 'tuplex.aws.lambdaTimeout': '600', 'tuplex.aws.maxConcurrency': '100', 'tuplex.aws.region': 'us-east-1', 'tuplex.aws.requestTimeout': '600', 'tuplex.aws.requesterPay': 'false', 'tuplex.aws.scratchDir': '', 'tuplex.backend': 'local', 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': 'cc956b40c9fa', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.network.caFile': '', 'tuplex.network.caPath': '', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.3.1-py3.6.egg/tuplex/libexec/tuplex_runtime.so', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp/tuplex-cache-tuplex', 'tuplex.webui.mongodb.path': '/tmp/tuplex-cache-tuplex/mongodb', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0232402,"llvm_optimization_time_s":0.33809,"llvm_compilation_time_s":0.155897,"total_compilation_time_s":0.511237,"sampling_time_s":0.114751,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.3361,"fast_path_time_s":2.8113,"fast_path_per_row_time_ns":786.787,"slow_path_wall_time_s":2.00482,"slow_path_time_s":0.133503,"slow_path_per_row_time_ns":290.726,"partitions_swapin_count":0,"partitions_swapout_count":0,"partitions_bytes_swapped_in":0,"partitions_bytes_swapped_out":0}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.009301424026489258, "jobTime": 4.004438638687134, "mode": "resolve", "mergeExceptionsInOrder": false}
[2022-02-19 21:13:26.841] [local execution engine] [info] Stopped local executor E/1
[2022-02-19 21:13:26.847] [local execution engine] [info] Stopped local executor E/2
[2022-02-19 21:13:26.853] [local execution engine] [info] Stopped local executor E/3
[2022-02-19 21:13:26.859] [local execution engine] [info] Stopped local executor E/4
[2022-02-19 21:13:26.865] [local execution engine] [info] Stopped local executor E/5
[2022-02-19 21:13:26.870] [local execution engine] [info] Stopped local executor E/6
[2022-02-19 21:13:26.876] [local execution engine] [info] Stopped local executor E/7
[2022-02-19 21:13:26.882] [local execution engine] [info] Stopped local executor E/8
[2022-02-19 21:13:26.887] [local execution engine] [info] Stopped local executor E/9
[2022-02-19 21:13:26.893] [local execution engine] [info] Stopped local executor E/10
[2022-02-19 21:13:26.899] [local execution engine] [info] Stopped local executor E/11
[2022-02-19 21:13:26.904] [local execution engine] [info] Stopped local executor E/12
[2022-02-19 21:13:26.910] [local execution engine] [info] Stopped local executor E/13
[2022-02-19 21:13:26.915] [local execution engine] [info] Stopped local executor E/14
[2022-02-19 21:13:26.921] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
