[2021-03-25 10:29:52.816] [global] [error] could not find backend, defaulting to local
[2021-03-25 10:29:52.816] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-25 10:29:52.816] [local ee] [info] initializing LLVM backend
[2021-03-25 10:29:52.816] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-25 10:29:52.816] [LLVM] [info] compiling code for skylake-avx512
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/1] [info] starting detached process queue
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/2] [info] starting detached process queue
[2021-03-25 10:29:52.817] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.817] [E/3] [info] starting detached process queue
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.817] [E/4] [info] starting detached process queue
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/5] [info] starting detached process queue
[2021-03-25 10:29:52.817] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.817] [E/6] [info] starting detached process queue
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/7] [info] starting detached process queue
[2021-03-25 10:29:52.817] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.817] [E/8] [info] starting detached process queue
[2021-03-25 10:29:52.817] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.817] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.818] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.818] [E/9] [info] starting detached process queue
[2021-03-25 10:29:52.818] [E/10] [info] starting detached process queue
[2021-03-25 10:29:52.818] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.818] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.818] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.818] [E/11] [info] starting detached process queue
[2021-03-25 10:29:52.818] [E/12] [info] starting detached process queue
[2021-03-25 10:29:52.818] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.818] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.818] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.818] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.818] [E/13] [info] starting detached process queue
[2021-03-25 10:29:52.818] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.818] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-25 10:29:52.818] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.818] [E/14] [info] starting detached process queue
[2021-03-25 10:29:52.818] [E/15] [info] starting detached process queue
[2021-03-25 10:29:52.818] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-25 10:29:52.818] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.818] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-25 10:29:52.818] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-25 10:29:52.818] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-25 10:29:52.818] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-25 10:29:52.954] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:52.961] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:52.976] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:52.985] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:53.012] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:53.032] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:53.046] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:53.079] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-25 10:29:53.085] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:53.101] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:53.103] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:53.104] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:53.104] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:53.106] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:53.107] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:53.108] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:53.110] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:53.111] [global] [info] detected type for resolve operator is (i64)
[2021-03-25 10:29:53.111] [global] [info] performing static typing for UDF in operator map
[2021-03-25 10:29:53.128] [logical planner] [info] logical optimization took 0.022841ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-25 10:29:53.128] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:53.128] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:53.129] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:53.130] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:53.130] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:53.131] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:53.132] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:53.133] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:53.134] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:53.134] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:53.135] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:53.136] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:53.137] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:53.138] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:53.139] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:53.140] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-25 10:29:53.141] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-25 10:29:53.141] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-25 10:29:53.142] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-25 10:29:53.142] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-25 10:29:53.143] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-25 10:29:53.144] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-25 10:29:53.145] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-25 10:29:53.146] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-25 10:29:53.146] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:53.148] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-25 10:29:53.149] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:53.149] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-25 10:29:53.150] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-25 10:29:53.182] [global] [info] Stage0 depends on: 
[2021-03-25 10:29:53.534] [global] [info] Optimization via LLVM passes took 0.334918 ms
[2021-03-25 10:29:53.687] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-25 10:29:53.687] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.505058s
[2021-03-25 10:29:53.687] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-25 10:29:53.969] [E/12] [info] [Task Finished] Transform to mem in 0.282145s (11153 normal rows, 42968 exceptions)
[2021-03-25 10:29:53.970] [E/14] [info] [Task Finished] Transform to mem in 0.282472s (11005 normal rows, 42744 exceptions)
[2021-03-25 10:29:53.970] [E/9] [info] [Task Finished] Transform to mem in 0.282528s (11036 normal rows, 43142 exceptions)
[2021-03-25 10:29:53.970] [E/4] [info] [Task Finished] Transform to mem in 0.282567s (11153 normal rows, 42970 exceptions)
[2021-03-25 10:29:53.970] [E/10] [info] [Task Finished] Transform to mem in 0.282567s (10997 normal rows, 42910 exceptions)
[2021-03-25 10:29:53.970] [E/1] [info] [Task Finished] Transform to mem in 0.282572s (11105 normal rows, 43095 exceptions)
[2021-03-25 10:29:53.970] [E/8] [info] [Task Finished] Transform to mem in 0.282956s (11005 normal rows, 42741 exceptions)
[2021-03-25 10:29:53.970] [E/6] [info] [Task Finished] Transform to mem in 0.283014s (10997 normal rows, 42873 exceptions)
[2021-03-25 10:29:53.970] [E/3] [info] [Task Finished] Transform to mem in 0.283029s (10987 normal rows, 43113 exceptions)
[2021-03-25 10:29:53.970] [E/13] [info] [Task Finished] Transform to mem in 0.283016s (11036 normal rows, 43139 exceptions)
[2021-03-25 10:29:53.971] [E/15] [info] [Task Finished] Transform to mem in 0.283380s (11008 normal rows, 43077 exceptions)
[2021-03-25 10:29:53.971] [driver] [info] [Task Finished] Transform to mem in 0.283417s (11092 normal rows, 43495 exceptions)
[2021-03-25 10:29:53.971] [E/2] [info] [Task Finished] Transform to mem in 0.283847s (11073 normal rows, 43414 exceptions)
[2021-03-25 10:29:53.972] [E/5] [info] [Task Finished] Transform to mem in 0.284632s (11086 normal rows, 43015 exceptions)
[2021-03-25 10:29:53.973] [E/11] [info] [Task Finished] Transform to mem in 0.285387s (11026 normal rows, 43206 exceptions)
[2021-03-25 10:29:53.973] [E/7] [info] [Task Finished] Transform to mem in 0.286146s (11047 normal rows, 43210 exceptions)
[2021-03-25 10:29:54.248] [E/12] [info] [Task Finished] Transform to mem in 0.278965s (11086 normal rows, 42996 exceptions)
[2021-03-25 10:29:54.249] [E/1] [info] [Task Finished] Transform to mem in 0.278805s (11023 normal rows, 42910 exceptions)
[2021-03-25 10:29:54.249] [E/4] [info] [Task Finished] Transform to mem in 0.279179s (11026 normal rows, 43205 exceptions)
[2021-03-25 10:29:54.249] [E/10] [info] [Task Finished] Transform to mem in 0.279259s (10982 normal rows, 43059 exceptions)
[2021-03-25 10:29:54.249] [E/8] [info] [Task Finished] Transform to mem in 0.278919s (11036 normal rows, 43115 exceptions)
[2021-03-25 10:29:54.249] [E/6] [info] [Task Finished] Transform to mem in 0.278883s (11005 normal rows, 42772 exceptions)
[2021-03-25 10:29:54.249] [E/9] [info] [Task Finished] Transform to mem in 0.279437s (11153 normal rows, 42978 exceptions)
[2021-03-25 10:29:54.250] [E/14] [info] [Task Finished] Transform to mem in 0.279886s (11092 normal rows, 43505 exceptions)
[2021-03-25 10:29:54.250] [driver] [info] [Task Finished] Transform to mem in 0.279146s (11076 normal rows, 43220 exceptions)
[2021-03-25 10:29:54.250] [E/13] [info] [Task Finished] Transform to mem in 0.279607s (11079 normal rows, 43539 exceptions)
[2021-03-25 10:29:54.250] [E/3] [info] [Task Finished] Transform to mem in 0.280191s (11086 normal rows, 42970 exceptions)
[2021-03-25 10:29:54.251] [E/2] [info] [Task Finished] Transform to mem in 0.279800s (10987 normal rows, 43068 exceptions)
[2021-03-25 10:29:54.251] [E/15] [info] [Task Finished] Transform to mem in 0.280511s (11111 normal rows, 42961 exceptions)
[2021-03-25 10:29:54.252] [E/5] [info] [Task Finished] Transform to mem in 0.279649s (11023 normal rows, 42880 exceptions)
[2021-03-25 10:29:54.252] [E/11] [info] [Task Finished] Transform to mem in 0.279713s (11036 normal rows, 43053 exceptions)
[2021-03-25 10:29:54.255] [E/7] [info] [Task Finished] Transform to mem in 0.281778s (10992 normal rows, 42864 exceptions)
[2021-03-25 10:29:54.528] [E/4] [info] [Task Finished] Transform to mem in 0.278858s (11127 normal rows, 42969 exceptions)
[2021-03-25 10:29:54.528] [E/1] [info] [Task Finished] Transform to mem in 0.279689s (11063 normal rows, 43617 exceptions)
[2021-03-25 10:29:54.528] [E/6] [info] [Task Finished] Transform to mem in 0.279220s (11004 normal rows, 42876 exceptions)
[2021-03-25 10:29:54.528] [E/9] [info] [Task Finished] Transform to mem in 0.279173s (11026 normal rows, 43041 exceptions)
[2021-03-25 10:29:54.528] [E/10] [info] [Task Finished] Transform to mem in 0.279334s (11076 normal rows, 43221 exceptions)
[2021-03-25 10:29:54.528] [E/8] [info] [Task Finished] Transform to mem in 0.279342s (10987 normal rows, 43063 exceptions)
[2021-03-25 10:29:54.529] [driver] [info] [Task Finished] Transform to mem in 0.279140s (11064 normal rows, 42832 exceptions)
[2021-03-25 10:29:54.529] [E/13] [info] [Task Finished] Transform to mem in 0.279291s (11098 normal rows, 43603 exceptions)
[2021-03-25 10:29:54.529] [E/14] [info] [Task Finished] Transform to mem in 0.279799s (11021 normal rows, 42887 exceptions)
[2021-03-25 10:29:54.531] [E/12] [info] [Task Finished] Transform to mem in 0.282143s (11099 normal rows, 42882 exceptions)
[2021-03-25 10:29:54.531] [E/2] [info] [Task Finished] Transform to mem in 0.279732s (11076 normal rows, 43212 exceptions)
[2021-03-25 10:29:54.531] [E/5] [info] [Task Finished] Transform to mem in 0.279664s (11004 normal rows, 42913 exceptions)
[2021-03-25 10:29:54.532] [E/15] [info] [Task Finished] Transform to mem in 0.281027s (10987 normal rows, 43041 exceptions)
[2021-03-25 10:29:54.534] [E/3] [info] [Task Finished] Transform to mem in 0.283106s (11127 normal rows, 43028 exceptions)
[2021-03-25 10:29:54.535] [E/11] [info] [Task Finished] Transform to mem in 0.282129s (11026 normal rows, 43037 exceptions)
[2021-03-25 10:29:54.537] [E/7] [info] [Task Finished] Transform to mem in 0.281456s (11012 normal rows, 42883 exceptions)
[2021-03-25 10:29:54.806] [E/4] [info] [Task Finished] Transform to mem in 0.278014s (11073 normal rows, 42820 exceptions)
[2021-03-25 10:29:54.807] [E/9] [info] [Task Finished] Transform to mem in 0.278733s (11076 normal rows, 43152 exceptions)
[2021-03-25 10:29:54.808] [E/13] [info] [Task Finished] Transform to mem in 0.278334s (11012 normal rows, 42888 exceptions)
[2021-03-25 10:29:54.808] [E/6] [info] [Task Finished] Transform to mem in 0.279272s (11130 normal rows, 43084 exceptions)
[2021-03-25 10:29:54.808] [E/8] [info] [Task Finished] Transform to mem in 0.279296s (11015 normal rows, 42966 exceptions)
[2021-03-25 10:29:54.808] [E/10] [info] [Task Finished] Transform to mem in 0.279821s (10976 normal rows, 43110 exceptions)
[2021-03-25 10:29:54.809] [E/1] [info] [Task Finished] Transform to mem in 0.280266s (11095 normal rows, 43503 exceptions)
[2021-03-25 10:29:54.809] [driver] [info] [Task Finished] Transform to mem in 0.279707s (11026 normal rows, 43035 exceptions)
[2021-03-25 10:29:54.809] [E/14] [info] [Task Finished] Transform to mem in 0.279558s (11073 normal rows, 42754 exceptions)
[2021-03-25 10:29:54.810] [E/5] [info] [Task Finished] Transform to mem in 0.278449s (11069 normal rows, 43142 exceptions)
[2021-03-25 10:29:54.810] [E/2] [info] [Task Finished] Transform to mem in 0.279050s (11130 normal rows, 43033 exceptions)
[2021-03-25 10:29:54.813] [E/15] [info] [Task Finished] Transform to mem in 0.280314s (10974 normal rows, 43172 exceptions)
[2021-03-25 10:29:54.813] [E/12] [info] [Task Finished] Transform to mem in 0.282323s (11095 normal rows, 43552 exceptions)
[2021-03-25 10:29:54.814] [E/11] [info] [Task Finished] Transform to mem in 0.279355s (11042 normal rows, 43023 exceptions)
[2021-03-25 10:29:54.816] [E/3] [info] [Task Finished] Transform to mem in 0.282026s (11008 normal rows, 42964 exceptions)
[2021-03-25 10:29:54.818] [E/7] [info] [Task Finished] Transform to mem in 0.281221s (11012 normal rows, 42911 exceptions)
[2021-03-25 10:29:55.084] [E/4] [info] [Task Finished] Transform to mem in 0.278216s (11063 normal rows, 42726 exceptions)
[2021-03-25 10:29:55.086] [E/13] [info] [Task Finished] Transform to mem in 0.278864s (11081 normal rows, 43050 exceptions)
[2021-03-25 10:29:55.087] [E/9] [info] [Task Finished] Transform to mem in 0.279336s (11105 normal rows, 43555 exceptions)
[2021-03-25 10:29:55.087] [E/6] [info] [Task Finished] Transform to mem in 0.279106s (11087 normal rows, 43150 exceptions)
[2021-03-25 10:29:55.087] [E/8] [info] [Task Finished] Transform to mem in 0.279388s (11005 normal rows, 43164 exceptions)
[2021-03-25 10:29:55.088] [E/10] [info] [Task Finished] Transform to mem in 0.279574s (11008 normal rows, 42975 exceptions)
[2021-03-25 10:29:55.088] [E/14] [info] [Task Finished] Transform to mem in 0.279219s (11073 normal rows, 42720 exceptions)
[2021-03-25 10:29:55.088] [driver] [info] [Task Finished] Transform to mem in 0.279690s (11002 normal rows, 42964 exceptions)
[2021-03-25 10:29:55.088] [E/1] [info] [Task Finished] Transform to mem in 0.279805s (11042 normal rows, 42959 exceptions)
[2021-03-25 10:29:55.089] [E/2] [info] [Task Finished] Transform to mem in 0.279095s (11098 normal rows, 43112 exceptions)
[2021-03-25 10:29:55.089] [E/5] [info] [Task Finished] Transform to mem in 0.279371s (11088 normal rows, 43511 exceptions)
[2021-03-25 10:29:55.093] [E/15] [info] [Task Finished] Transform to mem in 0.280162s (11087 normal rows, 43044 exceptions)
[2021-03-25 10:29:55.095] [E/12] [info] [Task Finished] Transform to mem in 0.281599s (11005 normal rows, 43229 exceptions)
[2021-03-25 10:29:55.096] [E/11] [info] [Task Finished] Transform to mem in 0.282515s (11008 normal rows, 43017 exceptions)
[2021-03-25 10:29:55.098] [E/3] [info] [Task Finished] Transform to mem in 0.282380s (11024 normal rows, 42947 exceptions)
[2021-03-25 10:29:55.099] [E/7] [info] [Task Finished] Transform to mem in 0.281249s (11020 normal rows, 42976 exceptions)
[2021-03-25 10:29:55.362] [E/4] [info] [Task Finished] Transform to mem in 0.278078s (11036 normal rows, 42710 exceptions)
[2021-03-25 10:29:55.365] [E/6] [info] [Task Finished] Transform to mem in 0.278588s (11087 normal rows, 42938 exceptions)
[2021-03-25 10:29:55.366] [E/9] [info] [Task Finished] Transform to mem in 0.279197s (11098 normal rows, 43115 exceptions)
[2021-03-25 10:29:55.366] [E/13] [info] [Task Finished] Transform to mem in 0.279275s (11125 normal rows, 43517 exceptions)
[2021-03-25 10:29:55.367] [E/8] [info] [Task Finished] Transform to mem in 0.279766s (10985 normal rows, 43336 exceptions)
[2021-03-25 10:29:55.368] [E/1] [info] [Task Finished] Transform to mem in 0.279118s (10995 normal rows, 42708 exceptions)
[2021-03-25 10:29:55.368] [E/14] [info] [Task Finished] Transform to mem in 0.279380s (11052 normal rows, 42881 exceptions)
[2021-03-25 10:29:55.368] [E/10] [info] [Task Finished] Transform to mem in 0.279962s (11000 normal rows, 42999 exceptions)
[2021-03-25 10:29:55.368] [driver] [info] [Task Finished] Transform to mem in 0.280003s (11020 normal rows, 43057 exceptions)
[2021-03-25 10:29:55.368] [E/5] [info] [Task Finished] Transform to mem in 0.279393s (11098 normal rows, 43075 exceptions)
[2021-03-25 10:29:55.369] [E/2] [info] [Task Finished] Transform to mem in 0.280300s (11166 normal rows, 43520 exceptions)
[2021-03-25 10:29:55.373] [E/15] [info] [Task Finished] Transform to mem in 0.280136s (11073 normal rows, 42970 exceptions)
[2021-03-25 10:29:55.375] [E/11] [info] [Task Finished] Transform to mem in 0.278904s (11000 normal rows, 43009 exceptions)
[2021-03-25 10:29:55.376] [E/12] [info] [Task Finished] Transform to mem in 0.281674s (10999 normal rows, 43334 exceptions)
[2021-03-25 10:29:55.379] [E/3] [info] [Task Finished] Transform to mem in 0.280903s (11052 normal rows, 42764 exceptions)
[2021-03-25 10:29:55.380] [E/7] [info] [Task Finished] Transform to mem in 0.281104s (11020 normal rows, 43138 exceptions)
[2021-03-25 10:29:55.641] [E/4] [info] [Task Finished] Transform to mem in 0.278470s (10995 normal rows, 42726 exceptions)
[2021-03-25 10:29:55.645] [E/13] [info] [Task Finished] Transform to mem in 0.279168s (11080 normal rows, 43031 exceptions)
[2021-03-25 10:29:55.645] [E/9] [info] [Task Finished] Transform to mem in 0.279316s (11091 normal rows, 43047 exceptions)
[2021-03-25 10:29:55.645] [E/6] [info] [Task Finished] Transform to mem in 0.280002s (11166 normal rows, 43508 exceptions)
[2021-03-25 10:29:55.646] [E/8] [info] [Task Finished] Transform to mem in 0.279433s (10999 normal rows, 43300 exceptions)
[2021-03-25 10:29:55.647] [driver] [info] [Task Finished] Transform to mem in 0.278683s (10995 normal rows, 42718 exceptions)
[2021-03-25 10:29:55.647] [E/10] [info] [Task Finished] Transform to mem in 0.279249s (11016 normal rows, 43165 exceptions)
[2021-03-25 10:29:55.647] [E/14] [info] [Task Finished] Transform to mem in 0.279746s (11036 normal rows, 42720 exceptions)
[2021-03-25 10:29:55.648] [E/5] [info] [Task Finished] Transform to mem in 0.279294s (11186 normal rows, 43465 exceptions)
[2021-03-25 10:29:55.648] [E/1] [info] [Task Finished] Transform to mem in 0.280272s (11000 normal rows, 43043 exceptions)
[2021-03-25 10:29:55.649] [E/2] [info] [Task Finished] Transform to mem in 0.279789s (11001 normal rows, 43113 exceptions)
[2021-03-25 10:29:55.653] [E/15] [info] [Task Finished] Transform to mem in 0.280505s (11170 normal rows, 43024 exceptions)
[2021-03-25 10:29:55.657] [E/11] [info] [Task Finished] Transform to mem in 0.281980s (10989 normal rows, 43282 exceptions)
[2021-03-25 10:29:55.659] [E/12] [info] [Task Finished] Transform to mem in 0.283073s (11010 normal rows, 43002 exceptions)
[2021-03-25 10:29:55.661] [E/3] [info] [Task Finished] Transform to mem in 0.281765s (11002 normal rows, 42755 exceptions)
[2021-03-25 10:29:55.662] [E/7] [info] [Task Finished] Transform to mem in 0.281901s (11050 normal rows, 43199 exceptions)
[2021-03-25 10:29:55.920] [E/4] [info] [Task Finished] Transform to mem in 0.279509s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:55.925] [E/6] [info] [Task Finished] Transform to mem in 0.279970s (11166 normal rows, 43023 exceptions)
[2021-03-25 10:29:55.925] [E/9] [info] [Task Finished] Transform to mem in 0.280335s (11045 normal rows, 43148 exceptions)
[2021-03-25 10:29:55.926] [E/13] [info] [Task Finished] Transform to mem in 0.280590s (11160 normal rows, 43455 exceptions)
[2021-03-25 10:29:55.927] [E/5] [info] [Task Finished] Transform to mem in 0.278763s (10973 normal rows, 42686 exceptions)
[2021-03-25 10:29:55.927] [E/8] [info] [Task Finished] Transform to mem in 0.280155s (10997 normal rows, 43283 exceptions)
[2021-03-25 10:29:55.927] [driver] [info] [Task Finished] Transform to mem in 0.280255s (11005 normal rows, 42971 exceptions)
[2021-03-25 10:29:55.927] [E/10] [info] [Task Finished] Transform to mem in 0.280293s (11007 normal rows, 42795 exceptions)
[2021-03-25 10:29:55.928] [E/1] [info] [Task Finished] Transform to mem in 0.280276s (11160 normal rows, 43446 exceptions)
[2021-03-25 10:29:55.929] [E/14] [info] [Task Finished] Transform to mem in 0.281108s (11050 normal rows, 43196 exceptions)
[2021-03-25 10:29:55.930] [E/2] [info] [Task Finished] Transform to mem in 0.280862s (11043 normal rows, 43153 exceptions)
[2021-03-25 10:29:55.934] [E/15] [info] [Task Finished] Transform to mem in 0.280317s (11168 normal rows, 43028 exceptions)
[2021-03-25 10:29:55.937] [E/11] [info] [Task Finished] Transform to mem in 0.279917s (10997 normal rows, 43277 exceptions)
[2021-03-25 10:29:55.943] [E/12] [info] [Task Finished] Transform to mem in 0.283196s (10997 normal rows, 42973 exceptions)
[2021-03-25 10:29:55.944] [E/7] [info] [Task Finished] Transform to mem in 0.281503s (11050 normal rows, 43170 exceptions)
[2021-03-25 10:29:55.944] [E/3] [info] [Task Finished] Transform to mem in 0.283316s (11015 normal rows, 42799 exceptions)
[2021-03-25 10:29:56.201] [E/4] [info] [Task Finished] Transform to mem in 0.280272s (10973 normal rows, 42710 exceptions)
[2021-03-25 10:29:56.205] [E/9] [info] [Task Finished] Transform to mem in 0.279777s (11043 normal rows, 43166 exceptions)
[2021-03-25 10:29:56.205] [E/6] [info] [Task Finished] Transform to mem in 0.279977s (11160 normal rows, 43431 exceptions)
[2021-03-25 10:29:56.205] [E/13] [info] [Task Finished] Transform to mem in 0.279908s (11168 normal rows, 43027 exceptions)
[2021-03-25 10:29:56.206] [E/5] [info] [Task Finished] Transform to mem in 0.279620s (10997 normal rows, 43237 exceptions)
[2021-03-25 10:29:56.207] [E/8] [info] [Task Finished] Transform to mem in 0.280166s (10997 normal rows, 43012 exceptions)
[2021-03-25 10:29:56.207] [E/10] [info] [Task Finished] Transform to mem in 0.279786s (11021 normal rows, 43160 exceptions)
[2021-03-25 10:29:56.207] [driver] [info] [Task Finished] Transform to mem in 0.279861s (11009 normal rows, 42805 exceptions)
[2021-03-25 10:29:56.208] [E/1] [info] [Task Finished] Transform to mem in 0.279413s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:56.209] [E/14] [info] [Task Finished] Transform to mem in 0.280190s (11165 normal rows, 43354 exceptions)
[2021-03-25 10:29:56.210] [E/2] [info] [Task Finished] Transform to mem in 0.279688s (11043 normal rows, 43217 exceptions)
[2021-03-25 10:29:56.214] [E/15] [info] [Task Finished] Transform to mem in 0.280010s (11156 normal rows, 43044 exceptions)
[2021-03-25 10:29:56.220] [E/11] [info] [Task Finished] Transform to mem in 0.283005s (11009 normal rows, 43187 exceptions)
[2021-03-25 10:29:56.225] [E/7] [info] [Task Finished] Transform to mem in 0.280821s (11009 normal rows, 42811 exceptions)
[2021-03-25 10:29:56.226] [E/12] [info] [Task Finished] Transform to mem in 0.283115s (10997 normal rows, 43067 exceptions)
[2021-03-25 10:29:56.227] [E/3] [info] [Task Finished] Transform to mem in 0.282838s (11021 normal rows, 43162 exceptions)
[2021-03-25 10:29:56.481] [E/4] [info] [Task Finished] Transform to mem in 0.280684s (11003 normal rows, 42716 exceptions)
[2021-03-25 10:29:56.485] [E/13] [info] [Task Finished] Transform to mem in 0.279694s (11172 normal rows, 43107 exceptions)
[2021-03-25 10:29:56.485] [E/9] [info] [Task Finished] Transform to mem in 0.280195s (11165 normal rows, 43260 exceptions)
[2021-03-25 10:29:56.486] [E/6] [info] [Task Finished] Transform to mem in 0.280054s (11027 normal rows, 43245 exceptions)
[2021-03-25 10:29:56.486] [E/5] [info] [Task Finished] Transform to mem in 0.279560s (10997 normal rows, 43177 exceptions)
[2021-03-25 10:29:56.487] [E/1] [info] [Task Finished] Transform to mem in 0.279643s (11000 normal rows, 42726 exceptions)
[2021-03-25 10:29:56.487] [E/10] [info] [Task Finished] Transform to mem in 0.280069s (10999 normal rows, 42828 exceptions)
[2021-03-25 10:29:56.488] [driver] [info] [Task Finished] Transform to mem in 0.280655s (11031 normal rows, 43157 exceptions)
[2021-03-25 10:29:56.488] [E/8] [info] [Task Finished] Transform to mem in 0.281230s (11009 normal rows, 43050 exceptions)
[2021-03-25 10:29:56.490] [E/14] [info] [Task Finished] Transform to mem in 0.281130s (11091 normal rows, 43230 exceptions)
[2021-03-25 10:29:56.491] [E/2] [info] [Task Finished] Transform to mem in 0.281112s (11099 normal rows, 43272 exceptions)
[2021-03-25 10:29:56.495] [E/15] [info] [Task Finished] Transform to mem in 0.280732s (11177 normal rows, 43113 exceptions)
[2021-03-25 10:29:56.501] [E/11] [info] [Task Finished] Transform to mem in 0.280231s (10997 normal rows, 43174 exceptions)
[2021-03-25 10:29:56.508] [E/7] [info] [Task Finished] Transform to mem in 0.283116s (10987 normal rows, 43020 exceptions)
[2021-03-25 10:29:56.510] [E/12] [info] [Task Finished] Transform to mem in 0.283883s (11020 normal rows, 42867 exceptions)
[2021-03-25 10:29:56.543] [E/3] [info] [Task Finished] Transform to mem in 0.315540s (12330 normal rows, 48094 exceptions)
[2021-03-25 10:29:56.543] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.85575s
[2021-03-25 10:29:56.543] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.9106s, 56350770 input rows, time to process 1 row via fast path: 0.000796982ms
[2021-03-25 10:29:56.543] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-25 10:29:56.547] [local ee] [info] compiled pure python pipeline in 0.004298s
[2021-03-25 10:29:56.547] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-25 10:29:56.548] [local ee] [info] Created 160 resolve tasks in 0.001284s
[2021-03-25 10:29:56.548] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-25 10:29:56.560] [E/5] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:29:56.560] [E/7] [info] [Task Finished] Resolve in 0.011922s
[2021-03-25 10:29:56.560] [E/3] [info] [Task Finished] Resolve in 0.011936s
[2021-03-25 10:29:56.560] [E/2] [info] [Task Finished] Resolve in 0.011924s
[2021-03-25 10:29:56.560] [E/8] [info] [Task Finished] Resolve in 0.011966s
[2021-03-25 10:29:56.560] [E/1] [info] [Task Finished] Resolve in 0.011979s
[2021-03-25 10:29:56.560] [E/4] [info] [Task Finished] Resolve in 0.011980s
[2021-03-25 10:29:56.560] [E/9] [info] [Task Finished] Resolve in 0.011956s
[2021-03-25 10:29:56.560] [driver] [info] [Task Finished] Resolve in 0.011998s
[2021-03-25 10:29:56.560] [E/6] [info] [Task Finished] Resolve in 0.012043s
[2021-03-25 10:29:56.560] [E/14] [info] [Task Finished] Resolve in 0.012058s
[2021-03-25 10:29:56.560] [E/11] [info] [Task Finished] Resolve in 0.012066s
[2021-03-25 10:29:56.560] [E/13] [info] [Task Finished] Resolve in 0.012075s
[2021-03-25 10:29:56.560] [E/15] [info] [Task Finished] Resolve in 0.012068s
[2021-03-25 10:29:56.560] [E/10] [info] [Task Finished] Resolve in 0.012077s
[2021-03-25 10:29:56.560] [E/12] [info] [Task Finished] Resolve in 0.012117s
[2021-03-25 10:29:56.572] [E/7] [info] [Task Finished] Resolve in 0.011759s
[2021-03-25 10:29:56.572] [E/1] [info] [Task Finished] Resolve in 0.011764s
[2021-03-25 10:29:56.572] [E/8] [info] [Task Finished] Resolve in 0.011797s
[2021-03-25 10:29:56.572] [E/4] [info] [Task Finished] Resolve in 0.011761s
[2021-03-25 10:29:56.572] [E/5] [info] [Task Finished] Resolve in 0.011924s
[2021-03-25 10:29:56.572] [E/12] [info] [Task Finished] Resolve in 0.011700s
[2021-03-25 10:29:56.572] [E/15] [info] [Task Finished] Resolve in 0.011747s
[2021-03-25 10:29:56.572] [E/13] [info] [Task Finished] Resolve in 0.011770s
[2021-03-25 10:29:56.572] [driver] [info] [Task Finished] Resolve in 0.011811s
[2021-03-25 10:29:56.572] [E/3] [info] [Task Finished] Resolve in 0.011913s
[2021-03-25 10:29:56.572] [E/14] [info] [Task Finished] Resolve in 0.011805s
[2021-03-25 10:29:56.572] [E/11] [info] [Task Finished] Resolve in 0.011826s
[2021-03-25 10:29:56.572] [E/2] [info] [Task Finished] Resolve in 0.011953s
[2021-03-25 10:29:56.572] [E/9] [info] [Task Finished] Resolve in 0.011931s
[2021-03-25 10:29:56.572] [E/10] [info] [Task Finished] Resolve in 0.011863s
[2021-03-25 10:29:56.572] [E/6] [info] [Task Finished] Resolve in 0.011972s
[2021-03-25 10:29:56.584] [E/8] [info] [Task Finished] Resolve in 0.011735s
[2021-03-25 10:29:56.584] [E/7] [info] [Task Finished] Resolve in 0.011855s
[2021-03-25 10:29:56.584] [E/15] [info] [Task Finished] Resolve in 0.011743s
[2021-03-25 10:29:56.584] [E/5] [info] [Task Finished] Resolve in 0.011788s
[2021-03-25 10:29:56.584] [driver] [info] [Task Finished] Resolve in 0.011754s
[2021-03-25 10:29:56.584] [E/3] [info] [Task Finished] Resolve in 0.011734s
[2021-03-25 10:29:56.584] [E/12] [info] [Task Finished] Resolve in 0.011784s
[2021-03-25 10:29:56.584] [E/11] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:29:56.584] [E/4] [info] [Task Finished] Resolve in 0.011902s
[2021-03-25 10:29:56.584] [E/9] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:29:56.584] [E/14] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:29:56.584] [E/2] [info] [Task Finished] Resolve in 0.011811s
[2021-03-25 10:29:56.584] [E/6] [info] [Task Finished] Resolve in 0.011754s
[2021-03-25 10:29:56.584] [E/1] [info] [Task Finished] Resolve in 0.012033s
[2021-03-25 10:29:56.584] [E/10] [info] [Task Finished] Resolve in 0.011824s
[2021-03-25 10:29:56.584] [E/13] [info] [Task Finished] Resolve in 0.012105s
[2021-03-25 10:29:56.596] [E/8] [info] [Task Finished] Resolve in 0.011748s
[2021-03-25 10:29:56.596] [E/7] [info] [Task Finished] Resolve in 0.011777s
[2021-03-25 10:29:56.596] [E/15] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:29:56.596] [E/5] [info] [Task Finished] Resolve in 0.011747s
[2021-03-25 10:29:56.596] [E/4] [info] [Task Finished] Resolve in 0.011698s
[2021-03-25 10:29:56.596] [driver] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:29:56.596] [E/3] [info] [Task Finished] Resolve in 0.011810s
[2021-03-25 10:29:56.596] [E/14] [info] [Task Finished] Resolve in 0.011766s
[2021-03-25 10:29:56.596] [E/9] [info] [Task Finished] Resolve in 0.011785s
[2021-03-25 10:29:56.596] [E/2] [info] [Task Finished] Resolve in 0.011836s
[2021-03-25 10:29:56.596] [E/11] [info] [Task Finished] Resolve in 0.011917s
[2021-03-25 10:29:56.596] [E/12] [info] [Task Finished] Resolve in 0.011948s
[2021-03-25 10:29:56.596] [E/10] [info] [Task Finished] Resolve in 0.011806s
[2021-03-25 10:29:56.596] [E/1] [info] [Task Finished] Resolve in 0.011890s
[2021-03-25 10:29:56.596] [E/13] [info] [Task Finished] Resolve in 0.011752s
[2021-03-25 10:29:56.596] [E/6] [info] [Task Finished] Resolve in 0.012002s
[2021-03-25 10:29:56.608] [E/8] [info] [Task Finished] Resolve in 0.011824s
[2021-03-25 10:29:56.608] [E/7] [info] [Task Finished] Resolve in 0.011855s
[2021-03-25 10:29:56.608] [E/5] [info] [Task Finished] Resolve in 0.011930s
[2021-03-25 10:29:56.608] [E/3] [info] [Task Finished] Resolve in 0.011866s
[2021-03-25 10:29:56.608] [E/14] [info] [Task Finished] Resolve in 0.011850s
[2021-03-25 10:29:56.608] [E/4] [info] [Task Finished] Resolve in 0.011952s
[2021-03-25 10:29:56.608] [driver] [info] [Task Finished] Resolve in 0.011936s
[2021-03-25 10:29:56.608] [E/9] [info] [Task Finished] Resolve in 0.011944s
[2021-03-25 10:29:56.608] [E/2] [info] [Task Finished] Resolve in 0.011946s
[2021-03-25 10:29:56.608] [E/15] [info] [Task Finished] Resolve in 0.012271s
[2021-03-25 10:29:56.608] [E/12] [info] [Task Finished] Resolve in 0.012060s
[2021-03-25 10:29:56.608] [E/10] [info] [Task Finished] Resolve in 0.012069s
[2021-03-25 10:29:56.608] [E/6] [info] [Task Finished] Resolve in 0.011942s
[2021-03-25 10:29:56.608] [E/13] [info] [Task Finished] Resolve in 0.012001s
[2021-03-25 10:29:56.608] [E/1] [info] [Task Finished] Resolve in 0.012033s
[2021-03-25 10:29:56.608] [E/11] [info] [Task Finished] Resolve in 0.012254s
[2021-03-25 10:29:56.619] [E/7] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:29:56.619] [E/8] [info] [Task Finished] Resolve in 0.011910s
[2021-03-25 10:29:56.620] [E/5] [info] [Task Finished] Resolve in 0.011798s
[2021-03-25 10:29:56.620] [E/4] [info] [Task Finished] Resolve in 0.011761s
[2021-03-25 10:29:56.620] [driver] [info] [Task Finished] Resolve in 0.011831s
[2021-03-25 10:29:56.620] [E/14] [info] [Task Finished] Resolve in 0.011885s
[2021-03-25 10:29:56.620] [E/9] [info] [Task Finished] Resolve in 0.011814s
[2021-03-25 10:29:56.620] [E/2] [info] [Task Finished] Resolve in 0.011843s
[2021-03-25 10:29:56.620] [E/3] [info] [Task Finished] Resolve in 0.012052s
[2021-03-25 10:29:56.620] [E/15] [info] [Task Finished] Resolve in 0.011850s
[2021-03-25 10:29:56.620] [E/10] [info] [Task Finished] Resolve in 0.011771s
[2021-03-25 10:29:56.620] [E/1] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:29:56.620] [E/6] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:29:56.620] [E/13] [info] [Task Finished] Resolve in 0.011865s
[2021-03-25 10:29:56.620] [E/12] [info] [Task Finished] Resolve in 0.012008s
[2021-03-25 10:29:56.620] [E/11] [info] [Task Finished] Resolve in 0.011834s
[2021-03-25 10:29:56.631] [E/7] [info] [Task Finished] Resolve in 0.011705s
[2021-03-25 10:29:56.631] [E/8] [info] [Task Finished] Resolve in 0.011736s
[2021-03-25 10:29:56.631] [E/5] [info] [Task Finished] Resolve in 0.011737s
[2021-03-25 10:29:56.631] [E/14] [info] [Task Finished] Resolve in 0.011697s
[2021-03-25 10:29:56.632] [E/2] [info] [Task Finished] Resolve in 0.011704s
[2021-03-25 10:29:56.632] [E/9] [info] [Task Finished] Resolve in 0.011817s
[2021-03-25 10:29:56.632] [E/4] [info] [Task Finished] Resolve in 0.011971s
[2021-03-25 10:29:56.632] [driver] [info] [Task Finished] Resolve in 0.011939s
[2021-03-25 10:29:56.632] [E/15] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:29:56.632] [E/10] [info] [Task Finished] Resolve in 0.011776s
[2021-03-25 10:29:56.632] [E/12] [info] [Task Finished] Resolve in 0.011680s
[2021-03-25 10:29:56.632] [E/6] [info] [Task Finished] Resolve in 0.011827s
[2021-03-25 10:29:56.632] [E/1] [info] [Task Finished] Resolve in 0.011850s
[2021-03-25 10:29:56.632] [E/3] [info] [Task Finished] Resolve in 0.012008s
[2021-03-25 10:29:56.632] [E/13] [info] [Task Finished] Resolve in 0.011816s
[2021-03-25 10:29:56.632] [E/11] [info] [Task Finished] Resolve in 0.011826s
[2021-03-25 10:29:56.643] [E/7] [info] [Task Finished] Resolve in 0.011678s
[2021-03-25 10:29:56.643] [E/8] [info] [Task Finished] Resolve in 0.011752s
[2021-03-25 10:29:56.643] [E/5] [info] [Task Finished] Resolve in 0.011725s
[2021-03-25 10:29:56.643] [E/2] [info] [Task Finished] Resolve in 0.011690s
[2021-03-25 10:29:56.643] [E/4] [info] [Task Finished] Resolve in 0.011740s
[2021-03-25 10:29:56.643] [driver] [info] [Task Finished] Resolve in 0.011748s
[2021-03-25 10:29:56.643] [E/9] [info] [Task Finished] Resolve in 0.011823s
[2021-03-25 10:29:56.643] [E/14] [info] [Task Finished] Resolve in 0.011976s
[2021-03-25 10:29:56.644] [E/10] [info] [Task Finished] Resolve in 0.011839s
[2021-03-25 10:29:56.644] [E/12] [info] [Task Finished] Resolve in 0.011762s
[2021-03-25 10:29:56.644] [E/6] [info] [Task Finished] Resolve in 0.011756s
[2021-03-25 10:29:56.644] [E/3] [info] [Task Finished] Resolve in 0.011775s
[2021-03-25 10:29:56.644] [E/15] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:29:56.644] [E/1] [info] [Task Finished] Resolve in 0.011881s
[2021-03-25 10:29:56.644] [E/11] [info] [Task Finished] Resolve in 0.011755s
[2021-03-25 10:29:56.644] [E/13] [info] [Task Finished] Resolve in 0.011883s
[2021-03-25 10:29:56.655] [E/7] [info] [Task Finished] Resolve in 0.011699s
[2021-03-25 10:29:56.655] [E/8] [info] [Task Finished] Resolve in 0.011750s
[2021-03-25 10:29:56.655] [E/2] [info] [Task Finished] Resolve in 0.011778s
[2021-03-25 10:29:56.655] [E/5] [info] [Task Finished] Resolve in 0.012000s
[2021-03-25 10:29:56.655] [driver] [info] [Task Finished] Resolve in 0.011799s
[2021-03-25 10:29:56.655] [E/4] [info] [Task Finished] Resolve in 0.011864s
[2021-03-25 10:29:56.655] [E/9] [info] [Task Finished] Resolve in 0.011829s
[2021-03-25 10:29:56.655] [E/14] [info] [Task Finished] Resolve in 0.011848s
[2021-03-25 10:29:56.655] [E/10] [info] [Task Finished] Resolve in 0.011712s
[2021-03-25 10:29:56.655] [E/3] [info] [Task Finished] Resolve in 0.011752s
[2021-03-25 10:29:56.655] [E/6] [info] [Task Finished] Resolve in 0.011818s
[2021-03-25 10:29:56.656] [E/15] [info] [Task Finished] Resolve in 0.011788s
[2021-03-25 10:29:56.656] [E/11] [info] [Task Finished] Resolve in 0.011780s
[2021-03-25 10:29:56.656] [E/12] [info] [Task Finished] Resolve in 0.011948s
[2021-03-25 10:29:56.656] [E/1] [info] [Task Finished] Resolve in 0.011837s
[2021-03-25 10:29:56.656] [E/13] [info] [Task Finished] Resolve in 0.011869s
[2021-03-25 10:29:56.666] [E/7] [info] [Task Finished] Resolve in 0.011674s
[2021-03-25 10:29:56.667] [E/8] [info] [Task Finished] Resolve in 0.011769s
[2021-03-25 10:29:56.667] [E/5] [info] [Task Finished] Resolve in 0.011876s
[2021-03-25 10:29:56.667] [E/4] [info] [Task Finished] Resolve in 0.011708s
[2021-03-25 10:29:56.667] [E/2] [info] [Task Finished] Resolve in 0.011984s
[2021-03-25 10:29:56.667] [E/9] [info] [Task Finished] Resolve in 0.011807s
[2021-03-25 10:29:56.667] [driver] [info] [Task Finished] Resolve in 0.011891s
[2021-03-25 10:29:56.667] [E/14] [info] [Task Finished] Resolve in 0.011886s
[2021-03-25 10:29:56.667] [E/10] [info] [Task Finished] Resolve in 0.011866s
[2021-03-25 10:29:56.667] [E/15] [info] [Task Finished] Resolve in 0.011858s
[2021-03-25 10:29:56.667] [E/6] [info] [Task Finished] Resolve in 0.011939s
[2021-03-25 10:29:56.667] [E/3] [info] [Task Finished] Resolve in 0.011994s
[2021-03-25 10:29:56.667] [E/12] [info] [Task Finished] Resolve in 0.011842s
[2021-03-25 10:29:56.667] [E/11] [info] [Task Finished] Resolve in 0.011899s
[2021-03-25 10:29:56.668] [E/1] [info] [Task Finished] Resolve in 0.011927s
[2021-03-25 10:29:56.669] [E/13] [info] [Task Finished] Resolve in 0.013356s
[2021-03-25 10:29:56.669] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 0.126497s
[2021-03-25 10:29:56.669] [local ee] [info] slow path for Stage 0: total wall clock time: 1.89881s, time to process 1 row via slow path: 0.000275353ms
[2021-03-25 10:29:56.669] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 0.126523s

[2021-03-25 10:29:56.708] [global] [info] Writing 1798491 rows as output to file (273.80 MB)
[2021-03-25 10:29:56.722] [E/12] [info] [Task Finished] write to file in 0.013780s (46082 rows, 7.02 MB)
[2021-03-25 10:29:56.740] [E/4] [info] [Task Finished] write to file in 0.031737s (112467 rows, 17.12 MB)
[2021-03-25 10:29:56.740] [E/1] [info] [Task Finished] write to file in 0.031761s (112421 rows, 17.11 MB)
[2021-03-25 10:29:56.740] [E/14] [info] [Task Finished] write to file in 0.031814s (112583 rows, 17.14 MB)
[2021-03-25 10:29:56.740] [E/5] [info] [Task Finished] write to file in 0.031951s (112438 rows, 17.12 MB)
[2021-03-25 10:29:56.740] [E/15] [info] [Task Finished] write to file in 0.032029s (112482 rows, 17.12 MB)
[2021-03-25 10:29:56.740] [E/9] [info] [Task Finished] write to file in 0.032040s (112459 rows, 17.12 MB)
[2021-03-25 10:29:56.740] [E/10] [info] [Task Finished] write to file in 0.032053s (112573 rows, 17.14 MB)
[2021-03-25 10:29:56.741] [E/11] [info] [Task Finished] write to file in 0.032290s (112425 rows, 17.11 MB)
[2021-03-25 10:29:56.742] [E/7] [info] [Task Finished] write to file in 0.033316s (123424 rows, 18.79 MB)
[2021-03-25 10:29:56.742] [E/3] [info] [Task Finished] write to file in 0.033372s (123389 rows, 18.78 MB)
[2021-03-25 10:29:56.742] [E/8] [info] [Task Finished] write to file in 0.033509s (123299 rows, 18.77 MB)
[2021-03-25 10:29:56.742] [E/6] [info] [Task Finished] write to file in 0.033568s (123377 rows, 18.78 MB)
[2021-03-25 10:29:56.742] [driver] [info] [Task Finished] write to file in 0.033591s (123251 rows, 18.76 MB)
[2021-03-25 10:29:56.742] [E/13] [info] [Task Finished] write to file in 0.033647s (123410 rows, 18.79 MB)
[2021-03-25 10:29:56.746] [E/2] [info] [Task Finished] write to file in 0.037883s (112411 rows, 17.11 MB)
[2021-03-25 10:29:56.746] [global] [info] writing output took 0.077089s
[2021-03-25 10:29:56.746] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0771761s
[2021-03-25 10:29:56.746] [global] [info] [Transform Stage] Stage 0 took 3.56454s
[2021-03-25 10:29:56.746] [global] [info] Query Execution took 3.64481s. (planning: 0.0802329s, execution: 3.56457s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 23 2021, 11:08:57) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.0061075687408447266
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 3.929385185241699 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': False, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '4e1bb76d17c5', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0228413,"llvm_optimization_time_s":0.334918,"llvm_compilation_time_s":0.152373,"total_compilation_time_s":0.505055,"sampling_time_s":0.111265,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.9106,"fast_path_time_s":2.85577,"fast_path_per_row_time_ns":796.982,"slow_path_wall_time_s":1.89881,"slow_path_time_s":0.126497,"slow_path_per_row_time_ns":275.353}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": false}
{"startupTime": 0.0061075687408447266, "jobTime": 3.929385185241699, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-25 10:29:56.771] [local execution engine] [info] Stopped local executor E/1
[2021-03-25 10:29:56.778] [local execution engine] [info] Stopped local executor E/2
[2021-03-25 10:29:56.784] [local execution engine] [info] Stopped local executor E/3
[2021-03-25 10:29:56.791] [local execution engine] [info] Stopped local executor E/4
[2021-03-25 10:29:56.797] [local execution engine] [info] Stopped local executor E/5
[2021-03-25 10:29:56.803] [local execution engine] [info] Stopped local executor E/6
[2021-03-25 10:29:56.810] [local execution engine] [info] Stopped local executor E/7
[2021-03-25 10:29:56.816] [local execution engine] [info] Stopped local executor E/8
[2021-03-25 10:29:56.822] [local execution engine] [info] Stopped local executor E/9
[2021-03-25 10:29:56.828] [local execution engine] [info] Stopped local executor E/10
[2021-03-25 10:29:56.834] [local execution engine] [info] Stopped local executor E/11
[2021-03-25 10:29:56.840] [local execution engine] [info] Stopped local executor E/12
[2021-03-25 10:29:56.847] [local execution engine] [info] Stopped local executor E/13
[2021-03-25 10:29:56.853] [local execution engine] [info] Stopped local executor E/14
[2021-03-25 10:29:56.859] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
