[2022-02-20 01:28:36.998] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.3.1-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2022-02-20 01:28:36.998] [local ee] [info] initializing LLVM backend
[2022-02-20 01:28:36.998] [local ee] [warning] init JIT compiler also only in local mode
[2022-02-20 01:28:36.998] [LLVM] [info] compiling code for skylake-avx512
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:36.999] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:37.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:37.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:37.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:37.000] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/1] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/2] [info] starting detached process queue
[2022-02-20 01:28:37.000] [E/1] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/3] [info] starting detached process queue
[2022-02-20 01:28:37.000] [E/2] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/3] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/4] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/4] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/5] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/5] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/6] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/6] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/7] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/7] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/8] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/9] [info] starting detached process queue
[2022-02-20 01:28:37.000] [E/8] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/9] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/10] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/10] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/11] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/11] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/12] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/12] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/13] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/13] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/14] [info] starting detached process queue
[2022-02-20 01:28:37.000] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.000] [E/14] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.000] [E/15] [info] starting detached process queue
[2022-02-20 01:28:37.000] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2022-02-20 01:28:37.000] [E/15] [info] initialized runtime memory (4.00 MB)
[2022-02-20 01:28:37.001] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
[2022-02-20 01:28:37.001] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2022-02-20 01:28:37.001] [global] [info] sampled file:///data/zillow/Z2_preprocessed/zillow_Z2_10G.csv on 256.00 KB
[2022-02-20 01:28:37.439] [logical planner] [info] logical optimization took 0.020893ms
[2022-02-20 01:28:37.469] [codegen] [info] generating pipeline for (str,str,str,str,f64,Option[str],str,str) -> (str,str,str,str,str,i64,f64,i64,str,str,i64) (13 operators pipelined)
[2022-02-20 01:28:37.470] [codegen] [info] generating function extractBd for ((str,str,str,str,f64,Option[str],str,str)) -> i64
[2022-02-20 01:28:37.470] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64)) -> boolean
[2022-02-20 01:28:37.471] [codegen] [info] generating function extractType for ((str,str,str,str,f64,Option[str],str,str,i64)) -> str
[2022-02-20 01:28:37.471] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> boolean
[2022-02-20 01:28:37.472] [codegen] [info] generating lambda function for ((str,str,str,str,f64,Option[str],str,str,i64,str)) -> str
[2022-02-20 01:28:37.473] [codegen] [info] generating lambda function for (str) -> str
[2022-02-20 01:28:37.473] [codegen] [info] generating function extractBa for ((str,str,str,str,f64,Option[str],str,str,i64,str,str)) -> f64
[2022-02-20 01:28:37.474] [codegen] [info] generating function extractSqft for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64)) -> i64
[2022-02-20 01:28:37.475] [codegen] [info] generating function extractOffer for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64)) -> str
[2022-02-20 01:28:37.476] [codegen] [info] generating function extractPrice for ((str,str,str,str,f64,Option[str],str,str,i64,str,str,f64,i64,str)) -> i64
[2022-02-20 01:28:37.477] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2022-02-20 01:28:37.478] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> boolean
[2022-02-20 01:28:37.478] [codegen] [info] generating lambda function for ((str,str,str,str,f64,i64,str,str,i64,str,str,f64,i64,str)) -> (str,str,str,str,str,i64,f64,i64,str,str,i64)
[2022-02-20 01:28:37.480] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2022-02-20 01:28:37.480] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2022-02-20 01:28:37.481] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2022-02-20 01:28:37.482] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2022-02-20 01:28:37.482] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2022-02-20 01:28:37.483] [codegen] [info] generating lambda function for (Option[str]) -> str
[2022-02-20 01:28:37.484] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2022-02-20 01:28:37.485] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2022-02-20 01:28:37.485] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2022-02-20 01:28:37.486] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2022-02-20 01:28:37.487] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-20 01:28:37.488] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2022-02-20 01:28:37.489] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2022-02-20 01:28:37.541] [global] [info] retrieved metrics object
[2022-02-20 01:28:37.837] [global] [info] Optimization via LLVM passes took 0.301791 ms
[2022-02-20 01:28:37.837] [global] [info] starting code compilation
[2022-02-20 01:28:37.837] [global] [info] first compile done
[2022-02-20 01:28:37.975] [global] [info] functor Stage_0 retrieved from llvm
[2022-02-20 01:28:37.975] [global] [info] retrieving init/release stage functors
[2022-02-20 01:28:37.975] [global] [info] Compiled code paths for stage 0 in 0.14 ms
[2022-02-20 01:28:37.975] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.455376s
[2022-02-20 01:28:37.975] [local ee] [info] split /data/zillow/Z2_preprocessed/zillow_Z2_10G.csv into 160 tasks
[2022-02-20 01:28:38.232] [E/8] [info] [Task Finished] Transform to mem in 0.256656s (13970 normal rows, 9902 exceptions)
[2022-02-20 01:28:38.232] [E/15] [info] [Task Finished] Transform to mem in 0.256862s (13953 normal rows, 9885 exceptions)
[2022-02-20 01:28:38.232] [E/7] [info] [Task Finished] Transform to mem in 0.257024s (13920 normal rows, 9892 exceptions)
[2022-02-20 01:28:38.233] [E/3] [info] [Task Finished] Transform to mem in 0.257103s (14206 normal rows, 10014 exceptions)
[2022-02-20 01:28:38.233] [E/14] [info] [Task Finished] Transform to mem in 0.257147s (14237 normal rows, 10021 exceptions)
[2022-02-20 01:28:38.233] [E/6] [info] [Task Finished] Transform to mem in 0.257180s (14242 normal rows, 10080 exceptions)
[2022-02-20 01:28:38.233] [E/5] [info] [Task Finished] Transform to mem in 0.257227s (14020 normal rows, 9982 exceptions)
[2022-02-20 01:28:38.233] [E/12] [info] [Task Finished] Transform to mem in 0.257368s (14177 normal rows, 10036 exceptions)
[2022-02-20 01:28:38.233] [E/9] [info] [Task Finished] Transform to mem in 0.257503s (14267 normal rows, 10106 exceptions)
[2022-02-20 01:28:38.233] [E/1] [info] [Task Finished] Transform to mem in 0.257516s (14217 normal rows, 10015 exceptions)
[2022-02-20 01:28:38.233] [E/13] [info] [Task Finished] Transform to mem in 0.257571s (13988 normal rows, 9938 exceptions)
[2022-02-20 01:28:38.233] [driver] [info] [Task Finished] Transform to mem in 0.257765s (14162 normal rows, 9952 exceptions)
[2022-02-20 01:28:38.233] [E/4] [info] [Task Finished] Transform to mem in 0.257810s (14226 normal rows, 10080 exceptions)
[2022-02-20 01:28:38.234] [E/11] [info] [Task Finished] Transform to mem in 0.258195s (14253 normal rows, 10088 exceptions)
[2022-02-20 01:28:38.234] [E/2] [info] [Task Finished] Transform to mem in 0.258639s (14207 normal rows, 10091 exceptions)
[2022-02-20 01:28:38.234] [E/10] [info] [Task Finished] Transform to mem in 0.258806s (14248 normal rows, 10023 exceptions)
[2022-02-20 01:28:38.485] [E/15] [info] [Task Finished] Transform to mem in 0.252348s (14059 normal rows, 9985 exceptions)
[2022-02-20 01:28:38.485] [E/8] [info] [Task Finished] Transform to mem in 0.252547s (14241 normal rows, 10100 exceptions)
[2022-02-20 01:28:38.485] [E/12] [info] [Task Finished] Transform to mem in 0.252133s (14086 normal rows, 9989 exceptions)
[2022-02-20 01:28:38.485] [E/5] [info] [Task Finished] Transform to mem in 0.252553s (14221 normal rows, 10009 exceptions)
[2022-02-20 01:28:38.485] [E/14] [info] [Task Finished] Transform to mem in 0.252650s (14081 normal rows, 9995 exceptions)
[2022-02-20 01:28:38.485] [E/6] [info] [Task Finished] Transform to mem in 0.252698s (14095 normal rows, 10009 exceptions)
[2022-02-20 01:28:38.485] [E/3] [info] [Task Finished] Transform to mem in 0.252788s (14238 normal rows, 10030 exceptions)
[2022-02-20 01:28:38.485] [E/9] [info] [Task Finished] Transform to mem in 0.252406s (14097 normal rows, 10002 exceptions)
[2022-02-20 01:28:38.486] [E/7] [info] [Task Finished] Transform to mem in 0.253095s (14114 normal rows, 10004 exceptions)
[2022-02-20 01:28:38.486] [E/11] [info] [Task Finished] Transform to mem in 0.252327s (14099 normal rows, 10008 exceptions)
[2022-02-20 01:28:38.486] [E/4] [info] [Task Finished] Transform to mem in 0.252843s (14212 normal rows, 10032 exceptions)
[2022-02-20 01:28:38.486] [E/13] [info] [Task Finished] Transform to mem in 0.253106s (14108 normal rows, 10027 exceptions)
[2022-02-20 01:28:38.486] [driver] [info] [Task Finished] Transform to mem in 0.252923s (14100 normal rows, 9955 exceptions)
[2022-02-20 01:28:38.486] [E/1] [info] [Task Finished] Transform to mem in 0.253414s (14212 normal rows, 10017 exceptions)
[2022-02-20 01:28:38.487] [E/2] [info] [Task Finished] Transform to mem in 0.252646s (14094 normal rows, 9965 exceptions)
[2022-02-20 01:28:38.489] [E/10] [info] [Task Finished] Transform to mem in 0.254549s (14223 normal rows, 10035 exceptions)
[2022-02-20 01:28:38.737] [E/8] [info] [Task Finished] Transform to mem in 0.251899s (14083 normal rows, 9953 exceptions)
[2022-02-20 01:28:38.737] [E/15] [info] [Task Finished] Transform to mem in 0.252265s (14089 normal rows, 10008 exceptions)
[2022-02-20 01:28:38.737] [E/9] [info] [Task Finished] Transform to mem in 0.251755s (13961 normal rows, 9925 exceptions)
[2022-02-20 01:28:38.737] [E/14] [info] [Task Finished] Transform to mem in 0.251927s (14002 normal rows, 9940 exceptions)
[2022-02-20 01:28:38.737] [E/12] [info] [Task Finished] Transform to mem in 0.252362s (14235 normal rows, 10062 exceptions)
[2022-02-20 01:28:38.738] [E/5] [info] [Task Finished] Transform to mem in 0.252286s (14170 normal rows, 9994 exceptions)
[2022-02-20 01:28:38.738] [E/4] [info] [Task Finished] Transform to mem in 0.251675s (13915 normal rows, 9900 exceptions)
[2022-02-20 01:28:38.738] [E/1] [info] [Task Finished] Transform to mem in 0.251846s (13892 normal rows, 9882 exceptions)
[2022-02-20 01:28:38.738] [E/3] [info] [Task Finished] Transform to mem in 0.252976s (14206 normal rows, 9991 exceptions)
[2022-02-20 01:28:38.738] [E/6] [info] [Task Finished] Transform to mem in 0.253032s (14226 normal rows, 10080 exceptions)
[2022-02-20 01:28:38.739] [E/7] [info] [Task Finished] Transform to mem in 0.253106s (14246 normal rows, 10084 exceptions)
[2022-02-20 01:28:38.739] [E/11] [info] [Task Finished] Transform to mem in 0.252832s (14233 normal rows, 10011 exceptions)
[2022-02-20 01:28:38.739] [driver] [info] [Task Finished] Transform to mem in 0.252755s (14267 normal rows, 10030 exceptions)
[2022-02-20 01:28:38.740] [E/2] [info] [Task Finished] Transform to mem in 0.252867s (14245 normal rows, 10101 exceptions)
[2022-02-20 01:28:38.740] [E/13] [info] [Task Finished] Transform to mem in 0.254055s (14253 normal rows, 10088 exceptions)
[2022-02-20 01:28:38.742] [E/10] [info] [Task Finished] Transform to mem in 0.253516s (14260 normal rows, 10025 exceptions)
[2022-02-20 01:28:38.989] [E/8] [info] [Task Finished] Transform to mem in 0.252015s (13978 normal rows, 9907 exceptions)
[2022-02-20 01:28:38.989] [E/12] [info] [Task Finished] Transform to mem in 0.252106s (14142 normal rows, 9989 exceptions)
[2022-02-20 01:28:38.990] [E/9] [info] [Task Finished] Transform to mem in 0.252431s (14234 normal rows, 10024 exceptions)
[2022-02-20 01:28:38.990] [E/4] [info] [Task Finished] Transform to mem in 0.252167s (13982 normal rows, 9975 exceptions)
[2022-02-20 01:28:38.990] [E/15] [info] [Task Finished] Transform to mem in 0.253412s (14181 normal rows, 10067 exceptions)
[2022-02-20 01:28:38.990] [E/5] [info] [Task Finished] Transform to mem in 0.252857s (14280 normal rows, 10094 exceptions)
[2022-02-20 01:28:38.990] [E/14] [info] [Task Finished] Transform to mem in 0.253264s (14015 normal rows, 9982 exceptions)
[2022-02-20 01:28:38.991] [E/3] [info] [Task Finished] Transform to mem in 0.252345s (14235 normal rows, 10040 exceptions)
[2022-02-20 01:28:38.991] [E/6] [info] [Task Finished] Transform to mem in 0.252295s (14054 normal rows, 9984 exceptions)
[2022-02-20 01:28:38.991] [E/1] [info] [Task Finished] Transform to mem in 0.252831s (14173 normal rows, 10006 exceptions)
[2022-02-20 01:28:38.991] [E/7] [info] [Task Finished] Transform to mem in 0.252553s (14129 normal rows, 10004 exceptions)
[2022-02-20 01:28:38.992] [E/11] [info] [Task Finished] Transform to mem in 0.252879s (14223 normal rows, 10033 exceptions)
[2022-02-20 01:28:38.992] [driver] [info] [Task Finished] Transform to mem in 0.252885s (14081 normal rows, 9992 exceptions)
[2022-02-20 01:28:38.993] [E/2] [info] [Task Finished] Transform to mem in 0.253470s (14108 normal rows, 10010 exceptions)
[2022-02-20 01:28:38.994] [E/13] [info] [Task Finished] Transform to mem in 0.253410s (14208 normal rows, 10008 exceptions)
[2022-02-20 01:28:38.995] [E/10] [info] [Task Finished] Transform to mem in 0.252926s (14089 normal rows, 10031 exceptions)
[2022-02-20 01:28:39.241] [E/8] [info] [Task Finished] Transform to mem in 0.252208s (14094 normal rows, 9960 exceptions)
[2022-02-20 01:28:39.241] [E/9] [info] [Task Finished] Transform to mem in 0.251738s (14088 normal rows, 10027 exceptions)
[2022-02-20 01:28:39.242] [E/12] [info] [Task Finished] Transform to mem in 0.252414s (14232 normal rows, 10017 exceptions)
[2022-02-20 01:28:39.242] [E/4] [info] [Task Finished] Transform to mem in 0.252184s (14106 normal rows, 9955 exceptions)
[2022-02-20 01:28:39.243] [E/14] [info] [Task Finished] Transform to mem in 0.252098s (14075 normal rows, 9965 exceptions)
[2022-02-20 01:28:39.243] [E/6] [info] [Task Finished] Transform to mem in 0.252274s (14095 normal rows, 9995 exceptions)
[2022-02-20 01:28:39.243] [E/5] [info] [Task Finished] Transform to mem in 0.252845s (14113 normal rows, 9997 exceptions)
[2022-02-20 01:28:39.243] [E/15] [info] [Task Finished] Transform to mem in 0.252931s (14211 normal rows, 10043 exceptions)
[2022-02-20 01:28:39.243] [E/1] [info] [Task Finished] Transform to mem in 0.252247s (14086 normal rows, 9952 exceptions)
[2022-02-20 01:28:39.244] [E/7] [info] [Task Finished] Transform to mem in 0.252364s (14226 normal rows, 10069 exceptions)
[2022-02-20 01:28:39.244] [E/3] [info] [Task Finished] Transform to mem in 0.253231s (14223 normal rows, 10049 exceptions)
[2022-02-20 01:28:39.244] [driver] [info] [Task Finished] Transform to mem in 0.252458s (14002 normal rows, 9931 exceptions)
[2022-02-20 01:28:39.245] [E/11] [info] [Task Finished] Transform to mem in 0.252964s (14170 normal rows, 9996 exceptions)
[2022-02-20 01:28:39.246] [E/2] [info] [Task Finished] Transform to mem in 0.252791s (14226 normal rows, 10080 exceptions)
[2022-02-20 01:28:39.247] [E/13] [info] [Task Finished] Transform to mem in 0.253471s (14206 normal rows, 10014 exceptions)
[2022-02-20 01:28:39.248] [E/10] [info] [Task Finished] Transform to mem in 0.252745s (13970 normal rows, 9902 exceptions)
[2022-02-20 01:28:39.496] [E/9] [info] [Task Finished] Transform to mem in 0.254564s (14233 normal rows, 10019 exceptions)
[2022-02-20 01:28:39.496] [E/8] [info] [Task Finished] Transform to mem in 0.255362s (14237 normal rows, 10084 exceptions)
[2022-02-20 01:28:39.497] [E/12] [info] [Task Finished] Transform to mem in 0.255007s (13920 normal rows, 9892 exceptions)
[2022-02-20 01:28:39.497] [E/6] [info] [Task Finished] Transform to mem in 0.254260s (13912 normal rows, 9882 exceptions)
[2022-02-20 01:28:39.498] [E/4] [info] [Task Finished] Transform to mem in 0.255313s (14267 normal rows, 10099 exceptions)
[2022-02-20 01:28:39.498] [E/14] [info] [Task Finished] Transform to mem in 0.255164s (14248 normal rows, 10030 exceptions)
[2022-02-20 01:28:39.498] [E/1] [info] [Task Finished] Transform to mem in 0.254447s (13988 normal rows, 9922 exceptions)
[2022-02-20 01:28:39.498] [E/15] [info] [Task Finished] Transform to mem in 0.255041s (14237 normal rows, 10021 exceptions)
[2022-02-20 01:28:39.499] [E/7] [info] [Task Finished] Transform to mem in 0.255262s (14171 normal rows, 10052 exceptions)
[2022-02-20 01:28:39.499] [E/3] [info] [Task Finished] Transform to mem in 0.255288s (14234 normal rows, 10024 exceptions)
[2022-02-20 01:28:39.499] [E/5] [info] [Task Finished] Transform to mem in 0.255980s (14248 normal rows, 10094 exceptions)
[2022-02-20 01:28:39.500] [driver] [info] [Task Finished] Transform to mem in 0.255270s (14015 normal rows, 9985 exceptions)
[2022-02-20 01:28:39.500] [E/11] [info] [Task Finished] Transform to mem in 0.255145s (14176 normal rows, 9997 exceptions)
[2022-02-20 01:28:39.501] [E/2] [info] [Task Finished] Transform to mem in 0.255294s (14246 normal rows, 10108 exceptions)
[2022-02-20 01:28:39.503] [E/13] [info] [Task Finished] Transform to mem in 0.255513s (14059 normal rows, 9978 exceptions)
[2022-02-20 01:28:39.504] [E/10] [info] [Task Finished] Transform to mem in 0.256092s (14114 normal rows, 10011 exceptions)
[2022-02-20 01:28:39.748] [E/9] [info] [Task Finished] Transform to mem in 0.251952s (14238 normal rows, 10007 exceptions)
[2022-02-20 01:28:39.748] [E/8] [info] [Task Finished] Transform to mem in 0.252094s (14081 normal rows, 10003 exceptions)
[2022-02-20 01:28:39.749] [E/12] [info] [Task Finished] Transform to mem in 0.252532s (14095 normal rows, 10024 exceptions)
[2022-02-20 01:28:39.750] [E/4] [info] [Task Finished] Transform to mem in 0.252318s (14086 normal rows, 9998 exceptions)
[2022-02-20 01:28:39.750] [E/14] [info] [Task Finished] Transform to mem in 0.252593s (14091 normal rows, 10001 exceptions)
[2022-02-20 01:28:39.751] [E/1] [info] [Task Finished] Transform to mem in 0.252831s (14218 normal rows, 10016 exceptions)
[2022-02-20 01:28:39.751] [E/15] [info] [Task Finished] Transform to mem in 0.252431s (14095 normal rows, 10026 exceptions)
[2022-02-20 01:28:39.751] [E/7] [info] [Task Finished] Transform to mem in 0.252321s (14113 normal rows, 9960 exceptions)
[2022-02-20 01:28:39.752] [E/5] [info] [Task Finished] Transform to mem in 0.252539s (14114 normal rows, 10012 exceptions)
[2022-02-20 01:28:39.752] [E/3] [info] [Task Finished] Transform to mem in 0.252938s (14197 normal rows, 10028 exceptions)
[2022-02-20 01:28:39.753] [driver] [info] [Task Finished] Transform to mem in 0.252912s (14094 normal rows, 9965 exceptions)
[2022-02-20 01:28:39.753] [E/11] [info] [Task Finished] Transform to mem in 0.252672s (14197 normal rows, 10033 exceptions)
[2022-02-20 01:28:39.753] [E/6] [info] [Task Finished] Transform to mem in 0.255760s (14221 normal rows, 9998 exceptions)
[2022-02-20 01:28:39.755] [E/2] [info] [Task Finished] Transform to mem in 0.253614s (14115 normal rows, 10010 exceptions)
[2022-02-20 01:28:39.756] [E/13] [info] [Task Finished] Transform to mem in 0.253541s (14083 normal rows, 9953 exceptions)
[2022-02-20 01:28:39.759] [E/10] [info] [Task Finished] Transform to mem in 0.254684s (14235 normal rows, 10048 exceptions)
[2022-02-20 01:28:40.002] [E/8] [info] [Task Finished] Transform to mem in 0.253804s (14015 normal rows, 9952 exceptions)
[2022-02-20 01:28:40.002] [E/9] [info] [Task Finished] Transform to mem in 0.254327s (14144 normal rows, 9995 exceptions)
[2022-02-20 01:28:40.004] [E/12] [info] [Task Finished] Transform to mem in 0.254065s (14237 normal rows, 10069 exceptions)
[2022-02-20 01:28:40.004] [E/4] [info] [Task Finished] Transform to mem in 0.253919s (14159 normal rows, 9996 exceptions)
[2022-02-20 01:28:40.004] [E/14] [info] [Task Finished] Transform to mem in 0.253406s (14010 normal rows, 9932 exceptions)
[2022-02-20 01:28:40.004] [E/7] [info] [Task Finished] Transform to mem in 0.252990s (13970 normal rows, 9902 exceptions)
[2022-02-20 01:28:40.005] [E/15] [info] [Task Finished] Transform to mem in 0.253705s (14178 normal rows, 10009 exceptions)
[2022-02-20 01:28:40.005] [E/1] [info] [Task Finished] Transform to mem in 0.253997s (14246 normal rows, 10084 exceptions)
[2022-02-20 01:28:40.006] [E/3] [info] [Task Finished] Transform to mem in 0.253788s (14236 normal rows, 10015 exceptions)
[2022-02-20 01:28:40.006] [E/5] [info] [Task Finished] Transform to mem in 0.254167s (14253 normal rows, 10088 exceptions)
[2022-02-20 01:28:40.006] [driver] [info] [Task Finished] Transform to mem in 0.253903s (13901 normal rows, 9892 exceptions)
[2022-02-20 01:28:40.007] [E/11] [info] [Task Finished] Transform to mem in 0.254079s (14267 normal rows, 10106 exceptions)
[2022-02-20 01:28:40.007] [E/6] [info] [Task Finished] Transform to mem in 0.253758s (14248 normal rows, 10023 exceptions)
[2022-02-20 01:28:40.008] [E/2] [info] [Task Finished] Transform to mem in 0.253467s (13953 normal rows, 9885 exceptions)
[2022-02-20 01:28:40.011] [E/13] [info] [Task Finished] Transform to mem in 0.254589s (14207 normal rows, 10091 exceptions)
[2022-02-20 01:28:40.014] [E/10] [info] [Task Finished] Transform to mem in 0.254820s (14245 normal rows, 10024 exceptions)
[2022-02-20 01:28:40.254] [E/8] [info] [Task Finished] Transform to mem in 0.251383s (13999 normal rows, 9935 exceptions)
[2022-02-20 01:28:40.254] [E/9] [info] [Task Finished] Transform to mem in 0.251814s (14158 normal rows, 10036 exceptions)
[2022-02-20 01:28:40.255] [E/4] [info] [Task Finished] Transform to mem in 0.251444s (14020 normal rows, 9989 exceptions)
[2022-02-20 01:28:40.256] [E/12] [info] [Task Finished] Transform to mem in 0.252020s (14242 normal rows, 10080 exceptions)
[2022-02-20 01:28:40.256] [E/7] [info] [Task Finished] Transform to mem in 0.251712s (14235 normal rows, 10041 exceptions)
[2022-02-20 01:28:40.256] [E/14] [info] [Task Finished] Transform to mem in 0.252303s (14173 normal rows, 10004 exceptions)
[2022-02-20 01:28:40.256] [E/15] [info] [Task Finished] Transform to mem in 0.251623s (14054 normal rows, 9985 exceptions)
[2022-02-20 01:28:40.257] [E/1] [info] [Task Finished] Transform to mem in 0.252158s (14114 normal rows, 10004 exceptions)
[2022-02-20 01:28:40.258] [E/5] [info] [Task Finished] Transform to mem in 0.251815s (14081 normal rows, 9992 exceptions)
[2022-02-20 01:28:40.258] [E/3] [info] [Task Finished] Transform to mem in 0.252236s (14238 normal rows, 10033 exceptions)
[2022-02-20 01:28:40.259] [E/11] [info] [Task Finished] Transform to mem in 0.252137s (14221 normal rows, 10009 exceptions)
[2022-02-20 01:28:40.259] [driver] [info] [Task Finished] Transform to mem in 0.252482s (14095 normal rows, 10009 exceptions)
[2022-02-20 01:28:40.259] [E/6] [info] [Task Finished] Transform to mem in 0.252140s (14089 normal rows, 9995 exceptions)
[2022-02-20 01:28:40.261] [E/2] [info] [Task Finished] Transform to mem in 0.252456s (14094 normal rows, 9996 exceptions)
[2022-02-20 01:28:40.264] [E/13] [info] [Task Finished] Transform to mem in 0.252986s (14212 normal rows, 10017 exceptions)
[2022-02-20 01:28:40.266] [E/10] [info] [Task Finished] Transform to mem in 0.252507s (14108 normal rows, 10027 exceptions)
[2022-02-20 01:28:40.505] [E/8] [info] [Task Finished] Transform to mem in 0.251638s (14100 normal rows, 9955 exceptions)
[2022-02-20 01:28:40.506] [E/9] [info] [Task Finished] Transform to mem in 0.251582s (14217 normal rows, 10042 exceptions)
[2022-02-20 01:28:40.506] [E/4] [info] [Task Finished] Transform to mem in 0.251212s (14094 normal rows, 9998 exceptions)
[2022-02-20 01:28:40.507] [E/12] [info] [Task Finished] Transform to mem in 0.251717s (14094 normal rows, 9965 exceptions)
[2022-02-20 01:28:40.508] [E/15] [info] [Task Finished] Transform to mem in 0.251306s (14086 normal rows, 9953 exceptions)
[2022-02-20 01:28:40.508] [E/14] [info] [Task Finished] Transform to mem in 0.251770s (14089 normal rows, 9995 exceptions)
[2022-02-20 01:28:40.509] [E/7] [info] [Task Finished] Transform to mem in 0.252683s (14223 normal rows, 10048 exceptions)
[2022-02-20 01:28:40.509] [E/1] [info] [Task Finished] Transform to mem in 0.252324s (14232 normal rows, 10069 exceptions)
[2022-02-20 01:28:40.510] [E/5] [info] [Task Finished] Transform to mem in 0.251713s (14170 normal rows, 9995 exceptions)
[2022-02-20 01:28:40.510] [E/6] [info] [Task Finished] Transform to mem in 0.251233s (13961 normal rows, 9907 exceptions)
[2022-02-20 01:28:40.511] [driver] [info] [Task Finished] Transform to mem in 0.251956s (14206 normal rows, 10009 exceptions)
[2022-02-20 01:28:40.511] [E/11] [info] [Task Finished] Transform to mem in 0.252119s (14226 normal rows, 10080 exceptions)
[2022-02-20 01:28:40.513] [E/3] [info] [Task Finished] Transform to mem in 0.254217s (14002 normal rows, 9932 exceptions)
[2022-02-20 01:28:40.514] [E/2] [info] [Task Finished] Transform to mem in 0.252896s (14246 normal rows, 10084 exceptions)
[2022-02-20 01:28:40.516] [E/13] [info] [Task Finished] Transform to mem in 0.252339s (14233 normal rows, 10019 exceptions)
[2022-02-20 01:28:40.560] [E/10] [info] [Task Finished] Transform to mem in 0.294194s (16320 normal rows, 11605 exceptions)
[2022-02-20 01:28:40.560] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.58552s
[2022-02-20 01:28:40.561] [global] [info] [Transform Stage] Stage 0 total wall clock time: 40.593s, 54108450 input rows, time to process 1 row via fast path: 0.000750215ms
[2022-02-20 01:28:40.561] [global] [info] Exception details: 
+------------+-------------------------------------+---------+
| OperatorID | Exception                           | Count   |
+------------+-------------------------------------+---------+
| 100000     | tuplex.internal.BadParseStringInput | 1602590 |
+------------+-------------------------------------+---------+
[2022-02-20 01:28:40.565] [local ee] [info] compiled pure python pipeline in 0.003954s
[2022-02-20 01:28:40.565] [local ee] [info] creating hybrid intermediates took 0.000003s
[2022-02-20 01:28:40.566] [local ee] [info] Created 160 resolve tasks in 0.001231s
[2022-02-20 01:28:40.566] [local ee] [info] 160/160 tasks require executing the slow path.
[2022-02-20 01:28:40.573] [E/3] [info] [Task Finished] Resolve in 0.006678s
[2022-02-20 01:28:40.573] [E/1] [info] [Task Finished] Resolve in 0.006708s
[2022-02-20 01:28:40.573] [E/2] [info] [Task Finished] Resolve in 0.006732s
[2022-02-20 01:28:40.573] [driver] [info] [Task Finished] Resolve in 0.006743s
[2022-02-20 01:28:40.573] [E/7] [info] [Task Finished] Resolve in 0.006709s
[2022-02-20 01:28:40.573] [E/14] [info] [Task Finished] Resolve in 0.006716s
[2022-02-20 01:28:40.573] [E/4] [info] [Task Finished] Resolve in 0.006797s
[2022-02-20 01:28:40.573] [E/13] [info] [Task Finished] Resolve in 0.006803s
[2022-02-20 01:28:40.573] [E/10] [info] [Task Finished] Resolve in 0.006798s
[2022-02-20 01:28:40.573] [E/5] [info] [Task Finished] Resolve in 0.006824s
[2022-02-20 01:28:40.573] [E/6] [info] [Task Finished] Resolve in 0.006806s
[2022-02-20 01:28:40.573] [E/15] [info] [Task Finished] Resolve in 0.006810s
[2022-02-20 01:28:40.573] [E/8] [info] [Task Finished] Resolve in 0.006803s
[2022-02-20 01:28:40.573] [E/12] [info] [Task Finished] Resolve in 0.006834s
[2022-02-20 01:28:40.573] [E/9] [info] [Task Finished] Resolve in 0.006846s
[2022-02-20 01:28:40.573] [E/11] [info] [Task Finished] Resolve in 0.006818s
[2022-02-20 01:28:40.579] [E/3] [info] [Task Finished] Resolve in 0.006616s
[2022-02-20 01:28:40.579] [E/2] [info] [Task Finished] Resolve in 0.006601s
[2022-02-20 01:28:40.579] [E/7] [info] [Task Finished] Resolve in 0.006621s
[2022-02-20 01:28:40.579] [E/14] [info] [Task Finished] Resolve in 0.006623s
[2022-02-20 01:28:40.579] [E/1] [info] [Task Finished] Resolve in 0.006693s
[2022-02-20 01:28:40.579] [E/13] [info] [Task Finished] Resolve in 0.006612s
[2022-02-20 01:28:40.579] [driver] [info] [Task Finished] Resolve in 0.006694s
[2022-02-20 01:28:40.579] [E/5] [info] [Task Finished] Resolve in 0.006627s
[2022-02-20 01:28:40.579] [E/4] [info] [Task Finished] Resolve in 0.006679s
[2022-02-20 01:28:40.579] [E/10] [info] [Task Finished] Resolve in 0.006659s
[2022-02-20 01:28:40.579] [E/8] [info] [Task Finished] Resolve in 0.006629s
[2022-02-20 01:28:40.579] [E/9] [info] [Task Finished] Resolve in 0.006602s
[2022-02-20 01:28:40.579] [E/6] [info] [Task Finished] Resolve in 0.006667s
[2022-02-20 01:28:40.579] [E/15] [info] [Task Finished] Resolve in 0.006635s
[2022-02-20 01:28:40.579] [E/12] [info] [Task Finished] Resolve in 0.006642s
[2022-02-20 01:28:40.579] [E/11] [info] [Task Finished] Resolve in 0.006653s
[2022-02-20 01:28:40.586] [E/3] [info] [Task Finished] Resolve in 0.006511s
[2022-02-20 01:28:40.586] [E/2] [info] [Task Finished] Resolve in 0.006519s
[2022-02-20 01:28:40.586] [E/7] [info] [Task Finished] Resolve in 0.006469s
[2022-02-20 01:28:40.586] [E/5] [info] [Task Finished] Resolve in 0.006433s
[2022-02-20 01:28:40.586] [E/14] [info] [Task Finished] Resolve in 0.006476s
[2022-02-20 01:28:40.586] [driver] [info] [Task Finished] Resolve in 0.006473s
[2022-02-20 01:28:40.586] [E/13] [info] [Task Finished] Resolve in 0.006521s
[2022-02-20 01:28:40.586] [E/1] [info] [Task Finished] Resolve in 0.006593s
[2022-02-20 01:28:40.586] [E/4] [info] [Task Finished] Resolve in 0.006564s
[2022-02-20 01:28:40.586] [E/9] [info] [Task Finished] Resolve in 0.006536s
[2022-02-20 01:28:40.586] [E/8] [info] [Task Finished] Resolve in 0.006603s
[2022-02-20 01:28:40.586] [E/12] [info] [Task Finished] Resolve in 0.006573s
[2022-02-20 01:28:40.586] [E/6] [info] [Task Finished] Resolve in 0.006601s
[2022-02-20 01:28:40.586] [E/15] [info] [Task Finished] Resolve in 0.006584s
[2022-02-20 01:28:40.586] [E/11] [info] [Task Finished] Resolve in 0.006596s
[2022-02-20 01:28:40.586] [E/10] [info] [Task Finished] Resolve in 0.006622s
[2022-02-20 01:28:40.592] [E/3] [info] [Task Finished] Resolve in 0.006592s
[2022-02-20 01:28:40.592] [E/2] [info] [Task Finished] Resolve in 0.006677s
[2022-02-20 01:28:40.593] [E/7] [info] [Task Finished] Resolve in 0.006661s
[2022-02-20 01:28:40.593] [E/13] [info] [Task Finished] Resolve in 0.006649s
[2022-02-20 01:28:40.593] [E/5] [info] [Task Finished] Resolve in 0.006731s
[2022-02-20 01:28:40.593] [E/14] [info] [Task Finished] Resolve in 0.006730s
[2022-02-20 01:28:40.593] [E/4] [info] [Task Finished] Resolve in 0.006708s
[2022-02-20 01:28:40.593] [driver] [info] [Task Finished] Resolve in 0.006811s
[2022-02-20 01:28:40.593] [E/1] [info] [Task Finished] Resolve in 0.006760s
[2022-02-20 01:28:40.593] [E/9] [info] [Task Finished] Resolve in 0.006712s
[2022-02-20 01:28:40.593] [E/12] [info] [Task Finished] Resolve in 0.006766s
[2022-02-20 01:28:40.593] [E/11] [info] [Task Finished] Resolve in 0.006736s
[2022-02-20 01:28:40.593] [E/8] [info] [Task Finished] Resolve in 0.006795s
[2022-02-20 01:28:40.593] [E/15] [info] [Task Finished] Resolve in 0.006751s
[2022-02-20 01:28:40.593] [E/6] [info] [Task Finished] Resolve in 0.006749s
[2022-02-20 01:28:40.593] [E/10] [info] [Task Finished] Resolve in 0.006764s
[2022-02-20 01:28:40.599] [E/3] [info] [Task Finished] Resolve in 0.006584s
[2022-02-20 01:28:40.599] [E/2] [info] [Task Finished] Resolve in 0.006601s
[2022-02-20 01:28:40.599] [E/13] [info] [Task Finished] Resolve in 0.006602s
[2022-02-20 01:28:40.599] [E/7] [info] [Task Finished] Resolve in 0.006647s
[2022-02-20 01:28:40.599] [E/5] [info] [Task Finished] Resolve in 0.006589s
[2022-02-20 01:28:40.599] [E/14] [info] [Task Finished] Resolve in 0.006614s
[2022-02-20 01:28:40.599] [E/4] [info] [Task Finished] Resolve in 0.006606s
[2022-02-20 01:28:40.599] [E/1] [info] [Task Finished] Resolve in 0.006617s
[2022-02-20 01:28:40.599] [E/9] [info] [Task Finished] Resolve in 0.006668s
[2022-02-20 01:28:40.599] [E/11] [info] [Task Finished] Resolve in 0.006589s
[2022-02-20 01:28:40.599] [driver] [info] [Task Finished] Resolve in 0.006732s
[2022-02-20 01:28:40.600] [E/10] [info] [Task Finished] Resolve in 0.006598s
[2022-02-20 01:28:40.600] [E/12] [info] [Task Finished] Resolve in 0.006648s
[2022-02-20 01:28:40.600] [E/8] [info] [Task Finished] Resolve in 0.006668s
[2022-02-20 01:28:40.600] [E/15] [info] [Task Finished] Resolve in 0.006672s
[2022-02-20 01:28:40.600] [E/6] [info] [Task Finished] Resolve in 0.006665s
[2022-02-20 01:28:40.606] [E/3] [info] [Task Finished] Resolve in 0.006558s
[2022-02-20 01:28:40.606] [E/13] [info] [Task Finished] Resolve in 0.006417s
[2022-02-20 01:28:40.606] [E/7] [info] [Task Finished] Resolve in 0.006446s
[2022-02-20 01:28:40.606] [E/2] [info] [Task Finished] Resolve in 0.006559s
[2022-02-20 01:28:40.606] [E/5] [info] [Task Finished] Resolve in 0.006571s
[2022-02-20 01:28:40.606] [E/4] [info] [Task Finished] Resolve in 0.006452s
[2022-02-20 01:28:40.606] [E/14] [info] [Task Finished] Resolve in 0.006568s
[2022-02-20 01:28:40.606] [E/9] [info] [Task Finished] Resolve in 0.006536s
[2022-02-20 01:28:40.606] [E/1] [info] [Task Finished] Resolve in 0.006603s
[2022-02-20 01:28:40.606] [E/10] [info] [Task Finished] Resolve in 0.006521s
[2022-02-20 01:28:40.606] [E/15] [info] [Task Finished] Resolve in 0.006507s
[2022-02-20 01:28:40.606] [E/11] [info] [Task Finished] Resolve in 0.006587s
[2022-02-20 01:28:40.606] [driver] [info] [Task Finished] Resolve in 0.006620s
[2022-02-20 01:28:40.606] [E/12] [info] [Task Finished] Resolve in 0.006558s
[2022-02-20 01:28:40.606] [E/6] [info] [Task Finished] Resolve in 0.006555s
[2022-02-20 01:28:40.606] [E/8] [info] [Task Finished] Resolve in 0.006606s
[2022-02-20 01:28:40.612] [E/3] [info] [Task Finished] Resolve in 0.006693s
[2022-02-20 01:28:40.612] [E/13] [info] [Task Finished] Resolve in 0.006647s
[2022-02-20 01:28:40.612] [E/7] [info] [Task Finished] Resolve in 0.006683s
[2022-02-20 01:28:40.612] [E/5] [info] [Task Finished] Resolve in 0.006673s
[2022-02-20 01:28:40.612] [E/2] [info] [Task Finished] Resolve in 0.006761s
[2022-02-20 01:28:40.613] [E/4] [info] [Task Finished] Resolve in 0.006734s
[2022-02-20 01:28:40.613] [E/14] [info] [Task Finished] Resolve in 0.006703s
[2022-02-20 01:28:40.613] [E/9] [info] [Task Finished] Resolve in 0.006689s
[2022-02-20 01:28:40.613] [E/1] [info] [Task Finished] Resolve in 0.006787s
[2022-02-20 01:28:40.613] [E/15] [info] [Task Finished] Resolve in 0.006737s
[2022-02-20 01:28:40.613] [E/10] [info] [Task Finished] Resolve in 0.006791s
[2022-02-20 01:28:40.613] [E/11] [info] [Task Finished] Resolve in 0.006773s
[2022-02-20 01:28:40.613] [E/6] [info] [Task Finished] Resolve in 0.006748s
[2022-02-20 01:28:40.613] [E/12] [info] [Task Finished] Resolve in 0.006751s
[2022-02-20 01:28:40.613] [driver] [info] [Task Finished] Resolve in 0.006815s
[2022-02-20 01:28:40.613] [E/8] [info] [Task Finished] Resolve in 0.006789s
[2022-02-20 01:28:40.619] [E/3] [info] [Task Finished] Resolve in 0.006523s
[2022-02-20 01:28:40.619] [E/13] [info] [Task Finished] Resolve in 0.006612s
[2022-02-20 01:28:40.619] [E/7] [info] [Task Finished] Resolve in 0.006655s
[2022-02-20 01:28:40.619] [E/2] [info] [Task Finished] Resolve in 0.006568s
[2022-02-20 01:28:40.619] [E/5] [info] [Task Finished] Resolve in 0.006610s
[2022-02-20 01:28:40.619] [E/4] [info] [Task Finished] Resolve in 0.006532s
[2022-02-20 01:28:40.619] [E/14] [info] [Task Finished] Resolve in 0.006625s
[2022-02-20 01:28:40.619] [E/9] [info] [Task Finished] Resolve in 0.006632s
[2022-02-20 01:28:40.619] [E/10] [info] [Task Finished] Resolve in 0.006549s
[2022-02-20 01:28:40.619] [E/12] [info] [Task Finished] Resolve in 0.006536s
[2022-02-20 01:28:40.620] [E/1] [info] [Task Finished] Resolve in 0.006671s
[2022-02-20 01:28:40.620] [E/15] [info] [Task Finished] Resolve in 0.006706s
[2022-02-20 01:28:40.620] [E/6] [info] [Task Finished] Resolve in 0.006670s
[2022-02-20 01:28:40.620] [E/11] [info] [Task Finished] Resolve in 0.006686s
[2022-02-20 01:28:40.620] [E/8] [info] [Task Finished] Resolve in 0.006665s
[2022-02-20 01:28:40.620] [driver] [info] [Task Finished] Resolve in 0.006688s
[2022-02-20 01:28:40.625] [E/3] [info] [Task Finished] Resolve in 0.006464s
[2022-02-20 01:28:40.625] [E/13] [info] [Task Finished] Resolve in 0.006517s
[2022-02-20 01:28:40.626] [E/7] [info] [Task Finished] Resolve in 0.006492s
[2022-02-20 01:28:40.626] [E/5] [info] [Task Finished] Resolve in 0.006549s
[2022-02-20 01:28:40.626] [E/2] [info] [Task Finished] Resolve in 0.006598s
[2022-02-20 01:28:40.626] [E/4] [info] [Task Finished] Resolve in 0.006557s
[2022-02-20 01:28:40.626] [E/14] [info] [Task Finished] Resolve in 0.006502s
[2022-02-20 01:28:40.626] [E/9] [info] [Task Finished] Resolve in 0.006471s
[2022-02-20 01:28:40.626] [E/10] [info] [Task Finished] Resolve in 0.006521s
[2022-02-20 01:28:40.626] [E/12] [info] [Task Finished] Resolve in 0.006527s
[2022-02-20 01:28:40.626] [E/15] [info] [Task Finished] Resolve in 0.006529s
[2022-02-20 01:28:40.626] [E/1] [info] [Task Finished] Resolve in 0.006612s
[2022-02-20 01:28:40.626] [E/6] [info] [Task Finished] Resolve in 0.006525s
[2022-02-20 01:28:40.626] [E/11] [info] [Task Finished] Resolve in 0.006539s
[2022-02-20 01:28:40.626] [E/8] [info] [Task Finished] Resolve in 0.006572s
[2022-02-20 01:28:40.626] [driver] [info] [Task Finished] Resolve in 0.006570s
[2022-02-20 01:28:40.632] [E/3] [info] [Task Finished] Resolve in 0.006581s
[2022-02-20 01:28:40.632] [E/13] [info] [Task Finished] Resolve in 0.006658s
[2022-02-20 01:28:40.632] [E/7] [info] [Task Finished] Resolve in 0.006657s
[2022-02-20 01:28:40.632] [E/5] [info] [Task Finished] Resolve in 0.006631s
[2022-02-20 01:28:40.632] [E/2] [info] [Task Finished] Resolve in 0.006623s
[2022-02-20 01:28:40.632] [E/4] [info] [Task Finished] Resolve in 0.006628s
[2022-02-20 01:28:40.632] [E/14] [info] [Task Finished] Resolve in 0.006714s
[2022-02-20 01:28:40.633] [E/9] [info] [Task Finished] Resolve in 0.006719s
[2022-02-20 01:28:40.633] [E/12] [info] [Task Finished] Resolve in 0.006635s
[2022-02-20 01:28:40.633] [E/10] [info] [Task Finished] Resolve in 0.006760s
[2022-02-20 01:28:40.633] [E/6] [info] [Task Finished] Resolve in 0.006694s
[2022-02-20 01:28:40.633] [E/15] [info] [Task Finished] Resolve in 0.006750s
[2022-02-20 01:28:40.633] [E/1] [info] [Task Finished] Resolve in 0.006759s
[2022-02-20 01:28:40.633] [E/11] [info] [Task Finished] Resolve in 0.006767s
[2022-02-20 01:28:40.633] [E/8] [info] [Task Finished] Resolve in 0.006760s
[2022-02-20 01:28:40.634] [driver] [info] [Task Finished] Resolve in 0.007718s
[2022-02-20 01:28:40.634] [local ee] [info] slow path resolved 1602590/1602590 exceptions in 0.0735468s
[2022-02-20 01:28:40.634] [local ee] [info] slow path for Stage 0: total wall clock time: 1.06401s, time to process 1 row via slow path: 0.000663931ms
[2022-02-20 01:28:40.634] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.0735814s

[2022-02-20 01:28:40.634] [global] [info] Writing 2264570 rows as output to file (344.74 MB)
[2022-02-20 01:28:40.653] [E/14] [info] [Task Finished] write to file in 0.018725s (87192 rows, 13.27 MB)
[2022-02-20 01:28:40.667] [E/7] [info] [Task Finished] write to file in 0.032153s (155395 rows, 23.66 MB)
[2022-02-20 01:28:40.667] [E/9] [info] [Task Finished] write to file in 0.032268s (155530 rows, 23.67 MB)
[2022-02-20 01:28:40.667] [E/5] [info] [Task Finished] write to file in 0.032339s (155704 rows, 23.70 MB)
[2022-02-20 01:28:40.667] [E/11] [info] [Task Finished] write to file in 0.032649s (155541 rows, 23.68 MB)
[2022-02-20 01:28:40.667] [E/12] [info] [Task Finished] write to file in 0.032633s (155415 rows, 23.66 MB)
[2022-02-20 01:28:40.667] [E/13] [info] [Task Finished] write to file in 0.032646s (155476 rows, 23.67 MB)
[2022-02-20 01:28:40.667] [E/8] [info] [Task Finished] write to file in 0.032711s (155476 rows, 23.67 MB)
[2022-02-20 01:28:40.667] [E/10] [info] [Task Finished] write to file in 0.032709s (155417 rows, 23.66 MB)
[2022-02-20 01:28:40.667] [E/3] [info] [Task Finished] write to file in 0.032742s (155417 rows, 23.66 MB)
[2022-02-20 01:28:40.667] [E/2] [info] [Task Finished] write to file in 0.032749s (155626 rows, 23.69 MB)
[2022-02-20 01:28:40.668] [E/4] [info] [Task Finished] write to file in 0.032902s (155541 rows, 23.68 MB)
[2022-02-20 01:28:40.668] [E/15] [info] [Task Finished] write to file in 0.033139s (155606 rows, 23.69 MB)
[2022-02-20 01:28:40.668] [E/6] [info] [Task Finished] write to file in 0.033226s (155530 rows, 23.67 MB)
[2022-02-20 01:28:40.677] [E/1] [info] [Task Finished] write to file in 0.042222s (155704 rows, 23.70 MB)
[2022-02-20 01:28:40.677] [global] [info] writing output took 0.042750s
[2022-02-20 01:28:40.677] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0428339s
[2022-02-20 01:28:40.677] [global] [info] [Transform Stage] Stage 0 took 3.15754s
[2022-02-20 01:28:40.677] [global] [info] Query Execution took 3.26116s. (planning: 0.103593s, execution: 3.15757s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.3.1
            |_|
    
using Python 3.6.9 (default, Feb  8 2022, 16:30:43) 
[GCC 9.3.0] on linux
>>> running tuplex on ['/data/zillow/Z2_preprocessed/zillow_Z2_10G.csv']
Tuplex startup time: 0.009212732315063477
Tuplex job time: 3.6777470111846924 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': True, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.optimizer.mergeExceptionsInOrder': True, 'tuplex.optimizer.operatorReordering': False, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.network.verifySSL': False, 'tuplex.redirectToPythonLogging': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.optionalThreshold': 0.7, 'tuplex.aws.connectTimeout': '1', 'tuplex.aws.httpThreadCount': '32', 'tuplex.aws.lambdaMemory': '1536', 'tuplex.aws.lambdaTimeout': '600', 'tuplex.aws.maxConcurrency': '100', 'tuplex.aws.region': 'us-east-1', 'tuplex.aws.requestTimeout': '600', 'tuplex.aws.requesterPay': 'false', 'tuplex.aws.scratchDir': '', 'tuplex.backend': 'local', 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': 'cc956b40c9fa', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.network.caFile': '', 'tuplex.network.caPath': '', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.3.1-py3.6.egg/tuplex/libexec/tuplex_runtime.so', 'tuplex.runTimeMemory': '8MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp/tuplex-cache-tuplex', 'tuplex.webui.mongodb.path': '/tmp/tuplex-cache-tuplex/mongodb', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0208933,"llvm_optimization_time_s":0.301791,"llvm_compilation_time_s":0.138176,"total_compilation_time_s":0.455374,"sampling_time_s":0.1144,"stages":[{"stage_no":0,"fast_path_wall_time_s":40.593,"fast_path_time_s":2.58553,"fast_path_per_row_time_ns":750.215,"slow_path_wall_time_s":1.06401,"slow_path_time_s":0.0735468,"slow_path_per_row_time_ns":663.931,"partitions_swapin_count":0,"partitions_swapout_count":0,"partitions_bytes_swapped_in":0,"partitions_bytes_swapped_out":0}]}
{"startupTime": 0.009212732315063477, "jobTime": 3.6777470111846924}
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.690] [local execution engine] [info] Stopped local executor E/1
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.694] [local execution engine] [info] Stopped local executor E/2
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.699] [local execution engine] [info] Stopped local executor E/3
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.703] [local execution engine] [info] Stopped local executor E/4
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.707] [local execution engine] [info] Stopped local executor E/5
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.711] [local execution engine] [info] Stopped local executor E/6
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.715] [local execution engine] [info] Stopped local executor E/7
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.719] [local execution engine] [info] Stopped local executor E/8
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.723] [local execution engine] [info] Stopped local executor E/9
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.727] [local execution engine] [info] Stopped local executor E/10
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.731] [local execution engine] [info] Stopped local executor E/11
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.736] [local execution engine] [info] Stopped local executor E/12
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.740] [local execution engine] [info] Stopped local executor E/13
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.744] [local execution engine] [info] Stopped local executor E/14
[GLOBAL] releasing 20 active partitions
[2022-02-20 01:28:40.747] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 21 active partitions
