[2021-03-31 14:38:01.811] [global] [error] could not find backend, defaulting to local
[2021-03-31 14:38:01.812] [local ee] [info] loaded runtime library from/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime.so
[2021-03-31 14:38:01.812] [local ee] [info] initializing LLVM backend
[2021-03-31 14:38:01.812] [local ee] [warning] init JIT compiler also only in local mode
[2021-03-31 14:38:01.812] [LLVM] [info] compiling code for skylake-avx512
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [memory] [info] allocated bitmap managed memory region (6.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/1 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/1] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/2 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/2] [info] starting detached process queue
[2021-03-31 14:38:01.813] [E/1] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/3 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/2] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [E/3] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/4 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/3] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/5 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/4] [info] starting detached process queue
[2021-03-31 14:38:01.813] [E/5] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/6 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/4] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [E/5] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [E/6] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/7 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/6] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [E/7] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/8 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/7] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [E/8] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/9 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/8] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [E/9] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/10 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/10] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/11 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/11] [info] starting detached process queue
[2021-03-31 14:38:01.813] [E/10] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [E/9] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/12 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/11] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/13 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/12] [info] starting detached process queue
[2021-03-31 14:38:01.813] [local execution engine] [info] started local executor E/14 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.813] [E/12] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.813] [E/13] [info] starting detached process queue
[2021-03-31 14:38:01.814] [E/14] [info] starting detached process queue
[2021-03-31 14:38:01.814] [local execution engine] [info] started local executor E/15 (6.00 GB, 32.00 MB default partition size)
[2021-03-31 14:38:01.814] [E/13] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.814] [E/14] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.814] [memory] [info] allocated bitmap managed memory region (10.00 GB, 32.00 MB block size)
[2021-03-31 14:38:01.814] [local execution engine] [info] started driver (10.00 GB, 32.00 MB default partition size)
overflow will be cached at file:///tmp/driver
[2021-03-31 14:38:01.814] [E/15] [info] starting detached process queue
[2021-03-31 14:38:01.814] [E/15] [info] initialized runtime memory (4.00 MB)
[2021-03-31 14:38:01.814] [fileinputoperator] [info] found 1 file (10.01 GB) to process.
[2021-03-31 14:38:01.814] [global] [info] sampled file:///data/zillow/Zdirty/zillow_dirty@10G.csv on 256.00 KB
[2021-03-31 14:38:01.948] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:38:01.955] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:38:01.970] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:38:01.979] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:38:02.006] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:38:02.026] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:38:02.040] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:38:02.072] [global] [info] performing static typing for UDF in operator withColumn
[2021-03-31 14:38:02.078] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:38:02.095] [global] [info] performing static typing for UDF in operator map
[2021-03-31 14:38:02.097] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:38:02.098] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:38:02.098] [global] [info] performing static typing for UDF in operator map
[2021-03-31 14:38:02.100] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:38:02.101] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:38:02.101] [global] [info] performing static typing for UDF in operator map
[2021-03-31 14:38:02.103] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:38:02.104] [global] [info] detected type for resolve operator is (i64)
[2021-03-31 14:38:02.105] [global] [info] performing static typing for UDF in operator map
[2021-03-31 14:38:02.121] [logical planner] [info] logical optimization took 0.022751ms
output type of specialized pipeline is: (str)
is this the most outer stage?: 1
[2021-03-31 14:38:02.121] [codegen] [info] generating pipeline for (Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str]) -> (str) (19 operators pipelined)
outSchema is different than last operator's schema:
outSchema: (str)
last Op: (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 14:38:02.122] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 14:38:02.123] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 14:38:02.123] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 14:38:02.124] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 14:38:02.125] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 14:38:02.125] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 14:38:02.126] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 14:38:02.127] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 14:38:02.128] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 14:38:02.129] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 14:38:02.130] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 14:38:02.131] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 14:38:02.131] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 14:38:02.133] [codegen] [info] generating function extractBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 14:38:02.134] [codegen] [info] generating function resolveBd for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str])) -> i64
[2021-03-31 14:38:02.134] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> boolean
[2021-03-31 14:38:02.135] [codegen] [info] generating function extractType for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64)) -> str
[2021-03-31 14:38:02.136] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> boolean
[2021-03-31 14:38:02.136] [codegen] [info] generating lambda function for ((Option[str],Option[str],Option[str],Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str)) -> str
[2021-03-31 14:38:02.137] [codegen] [info] generating lambda function for (Option[str]) -> str
[2021-03-31 14:38:02.138] [codegen] [info] generating function extractBa for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str)) -> f64
[2021-03-31 14:38:02.139] [codegen] [info] generating function extractSqft for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64)) -> i64
[2021-03-31 14:38:02.139] [codegen] [info] generating function extractOffer for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64)) -> str
[2021-03-31 14:38:02.140] [codegen] [info] generating function extractPrice for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 14:38:02.141] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],Option[str],Option[str],Option[str],i64,str,str,f64,i64,str)) -> i64
[2021-03-31 14:38:02.142] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 14:38:02.143] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> boolean
[2021-03-31 14:38:02.143] [codegen] [info] generating lambda function for ((Option[str],Option[str],str,Option[str],Option[f64],i64,Option[str],Option[str],i64,str,str,f64,i64,str)) -> (Option[str],str,Option[str],str,Option[str],i64,f64,i64,str,str,i64)
[2021-03-31 14:38:02.175] [global] [info] Stage0 depends on: 
[2021-03-31 14:38:02.527] [global] [info] Optimization via LLVM passes took 0.334691 ms
[2021-03-31 14:38:02.680] [global] [info] Compiled code paths for stage 0 in 0.15 ms
[2021-03-31 14:38:02.680] [global] [info] [Transform Stage] Stage 0 compiled to x86 in 0.505569s
[2021-03-31 14:38:02.681] [local ee] [info] split /data/zillow/Zdirty/zillow_dirty@10G.csv into 160 tasks
[2021-03-31 14:38:02.960] [E/2] [info] [Task Finished] Transform to mem in 0.278951s (11005 normal rows, 42744 exceptions)
[2021-03-31 14:38:02.960] [E/7] [info] [Task Finished] Transform to mem in 0.279209s (10997 normal rows, 42873 exceptions)
[2021-03-31 14:38:02.960] [E/13] [info] [Task Finished] Transform to mem in 0.279258s (11086 normal rows, 43015 exceptions)
[2021-03-31 14:38:02.960] [E/4] [info] [Task Finished] Transform to mem in 0.279343s (11105 normal rows, 43095 exceptions)
[2021-03-31 14:38:02.960] [E/8] [info] [Task Finished] Transform to mem in 0.279344s (11005 normal rows, 42741 exceptions)
[2021-03-31 14:38:02.960] [E/14] [info] [Task Finished] Transform to mem in 0.279346s (11036 normal rows, 43139 exceptions)
[2021-03-31 14:38:02.960] [E/5] [info] [Task Finished] Transform to mem in 0.279437s (10987 normal rows, 43113 exceptions)
[2021-03-31 14:38:02.960] [E/6] [info] [Task Finished] Transform to mem in 0.279494s (11036 normal rows, 43142 exceptions)
[2021-03-31 14:38:02.960] [E/12] [info] [Task Finished] Transform to mem in 0.279504s (11008 normal rows, 43077 exceptions)
[2021-03-31 14:38:02.961] [E/9] [info] [Task Finished] Transform to mem in 0.279717s (11047 normal rows, 43210 exceptions)
[2021-03-31 14:38:02.961] [E/10] [info] [Task Finished] Transform to mem in 0.279721s (10997 normal rows, 42910 exceptions)
[2021-03-31 14:38:02.961] [E/3] [info] [Task Finished] Transform to mem in 0.279780s (11073 normal rows, 43414 exceptions)
[2021-03-31 14:38:02.961] [E/1] [info] [Task Finished] Transform to mem in 0.279806s (11153 normal rows, 42970 exceptions)
[2021-03-31 14:38:02.961] [E/15] [info] [Task Finished] Transform to mem in 0.279808s (11153 normal rows, 42968 exceptions)
[2021-03-31 14:38:02.961] [driver] [info] [Task Finished] Transform to mem in 0.279969s (11026 normal rows, 43206 exceptions)
[2021-03-31 14:38:02.962] [E/11] [info] [Task Finished] Transform to mem in 0.281494s (11092 normal rows, 43495 exceptions)
[2021-03-31 14:38:03.236] [E/5] [info] [Task Finished] Transform to mem in 0.275939s (11036 normal rows, 43115 exceptions)
[2021-03-31 14:38:03.236] [E/2] [info] [Task Finished] Transform to mem in 0.276484s (11086 normal rows, 42996 exceptions)
[2021-03-31 14:38:03.237] [E/7] [info] [Task Finished] Transform to mem in 0.276472s (11092 normal rows, 43505 exceptions)
[2021-03-31 14:38:03.237] [E/12] [info] [Task Finished] Transform to mem in 0.276335s (11086 normal rows, 42970 exceptions)
[2021-03-31 14:38:03.237] [E/6] [info] [Task Finished] Transform to mem in 0.276376s (11005 normal rows, 42772 exceptions)
[2021-03-31 14:38:03.237] [E/14] [info] [Task Finished] Transform to mem in 0.276532s (11023 normal rows, 42910 exceptions)
[2021-03-31 14:38:03.237] [E/4] [info] [Task Finished] Transform to mem in 0.276570s (11026 normal rows, 43205 exceptions)
[2021-03-31 14:38:03.237] [E/13] [info] [Task Finished] Transform to mem in 0.276696s (11153 normal rows, 42978 exceptions)
[2021-03-31 14:38:03.237] [E/8] [info] [Task Finished] Transform to mem in 0.276667s (10982 normal rows, 43059 exceptions)
[2021-03-31 14:38:03.237] [E/3] [info] [Task Finished] Transform to mem in 0.276386s (11076 normal rows, 43220 exceptions)
[2021-03-31 14:38:03.237] [E/10] [info] [Task Finished] Transform to mem in 0.276623s (11111 normal rows, 42961 exceptions)
[2021-03-31 14:38:03.238] [E/9] [info] [Task Finished] Transform to mem in 0.276902s (11079 normal rows, 43539 exceptions)
[2021-03-31 14:38:03.238] [E/15] [info] [Task Finished] Transform to mem in 0.276929s (11023 normal rows, 42880 exceptions)
[2021-03-31 14:38:03.238] [driver] [info] [Task Finished] Transform to mem in 0.276861s (11036 normal rows, 43053 exceptions)
[2021-03-31 14:38:03.239] [E/1] [info] [Task Finished] Transform to mem in 0.278156s (10987 normal rows, 43068 exceptions)
[2021-03-31 14:38:03.240] [E/11] [info] [Task Finished] Transform to mem in 0.278014s (10992 normal rows, 42864 exceptions)
[2021-03-31 14:38:03.512] [E/5] [info] [Task Finished] Transform to mem in 0.275726s (11099 normal rows, 42882 exceptions)
[2021-03-31 14:38:03.513] [E/7] [info] [Task Finished] Transform to mem in 0.276097s (11127 normal rows, 42969 exceptions)
[2021-03-31 14:38:03.513] [E/14] [info] [Task Finished] Transform to mem in 0.276026s (11004 normal rows, 42876 exceptions)
[2021-03-31 14:38:03.513] [E/13] [info] [Task Finished] Transform to mem in 0.276087s (11021 normal rows, 42887 exceptions)
[2021-03-31 14:38:03.513] [E/4] [info] [Task Finished] Transform to mem in 0.276293s (11026 normal rows, 43041 exceptions)
[2021-03-31 14:38:03.513] [E/8] [info] [Task Finished] Transform to mem in 0.276184s (11064 normal rows, 42832 exceptions)
[2021-03-31 14:38:03.513] [E/6] [info] [Task Finished] Transform to mem in 0.276409s (10987 normal rows, 43063 exceptions)
[2021-03-31 14:38:03.513] [E/2] [info] [Task Finished] Transform to mem in 0.276890s (11063 normal rows, 43617 exceptions)
[2021-03-31 14:38:03.513] [E/12] [info] [Task Finished] Transform to mem in 0.276560s (11076 normal rows, 43221 exceptions)
[2021-03-31 14:38:03.514] [E/3] [info] [Task Finished] Transform to mem in 0.276632s (11098 normal rows, 43603 exceptions)
[2021-03-31 14:38:03.514] [E/10] [info] [Task Finished] Transform to mem in 0.276751s (11127 normal rows, 43028 exceptions)
[2021-03-31 14:38:03.514] [E/9] [info] [Task Finished] Transform to mem in 0.276518s (11076 normal rows, 43212 exceptions)
[2021-03-31 14:38:03.515] [driver] [info] [Task Finished] Transform to mem in 0.276949s (11004 normal rows, 42913 exceptions)
[2021-03-31 14:38:03.515] [E/15] [info] [Task Finished] Transform to mem in 0.277092s (10987 normal rows, 43041 exceptions)
[2021-03-31 14:38:03.517] [E/1] [info] [Task Finished] Transform to mem in 0.277905s (11026 normal rows, 43037 exceptions)
[2021-03-31 14:38:03.519] [E/11] [info] [Task Finished] Transform to mem in 0.278221s (11012 normal rows, 42883 exceptions)
[2021-03-31 14:38:03.788] [E/5] [info] [Task Finished] Transform to mem in 0.275705s (11073 normal rows, 42820 exceptions)
[2021-03-31 14:38:03.789] [E/7] [info] [Task Finished] Transform to mem in 0.276443s (11095 normal rows, 43503 exceptions)
[2021-03-31 14:38:03.789] [E/13] [info] [Task Finished] Transform to mem in 0.276314s (11076 normal rows, 43152 exceptions)
[2021-03-31 14:38:03.789] [E/6] [info] [Task Finished] Transform to mem in 0.276170s (11026 normal rows, 43035 exceptions)
[2021-03-31 14:38:03.789] [E/12] [info] [Task Finished] Transform to mem in 0.276120s (11073 normal rows, 42754 exceptions)
[2021-03-31 14:38:03.789] [E/2] [info] [Task Finished] Transform to mem in 0.276192s (11012 normal rows, 42888 exceptions)
[2021-03-31 14:38:03.790] [E/14] [info] [Task Finished] Transform to mem in 0.276872s (11130 normal rows, 43084 exceptions)
[2021-03-31 14:38:03.790] [E/4] [info] [Task Finished] Transform to mem in 0.276630s (10976 normal rows, 43110 exceptions)
[2021-03-31 14:38:03.790] [E/8] [info] [Task Finished] Transform to mem in 0.276768s (11015 normal rows, 42966 exceptions)
[2021-03-31 14:38:03.790] [E/9] [info] [Task Finished] Transform to mem in 0.276359s (11069 normal rows, 43142 exceptions)
[2021-03-31 14:38:03.791] [E/10] [info] [Task Finished] Transform to mem in 0.276526s (11130 normal rows, 43033 exceptions)
[2021-03-31 14:38:03.791] [E/3] [info] [Task Finished] Transform to mem in 0.276955s (11095 normal rows, 43552 exceptions)
[2021-03-31 14:38:03.791] [E/15] [info] [Task Finished] Transform to mem in 0.276538s (11008 normal rows, 42964 exceptions)
[2021-03-31 14:38:03.791] [driver] [info] [Task Finished] Transform to mem in 0.276785s (10974 normal rows, 43172 exceptions)
[2021-03-31 14:38:03.793] [E/1] [info] [Task Finished] Transform to mem in 0.275952s (11042 normal rows, 43023 exceptions)
[2021-03-31 14:38:03.797] [E/11] [info] [Task Finished] Transform to mem in 0.277970s (11012 normal rows, 42911 exceptions)
[2021-03-31 14:38:04.065] [E/5] [info] [Task Finished] Transform to mem in 0.277282s (11063 normal rows, 42726 exceptions)
[2021-03-31 14:38:04.066] [E/7] [info] [Task Finished] Transform to mem in 0.276653s (11105 normal rows, 43555 exceptions)
[2021-03-31 14:38:04.066] [E/13] [info] [Task Finished] Transform to mem in 0.276607s (11081 normal rows, 43050 exceptions)
[2021-03-31 14:38:04.066] [E/14] [info] [Task Finished] Transform to mem in 0.276301s (11042 normal rows, 42959 exceptions)
[2021-03-31 14:38:04.066] [E/6] [info] [Task Finished] Transform to mem in 0.276713s (11087 normal rows, 43150 exceptions)
[2021-03-31 14:38:04.066] [E/8] [info] [Task Finished] Transform to mem in 0.276282s (11073 normal rows, 42720 exceptions)
[2021-03-31 14:38:04.066] [E/12] [info] [Task Finished] Transform to mem in 0.276799s (11005 normal rows, 43164 exceptions)
[2021-03-31 14:38:04.066] [E/2] [info] [Task Finished] Transform to mem in 0.276934s (11008 normal rows, 42975 exceptions)
[2021-03-31 14:38:04.067] [E/4] [info] [Task Finished] Transform to mem in 0.276737s (11002 normal rows, 42964 exceptions)
[2021-03-31 14:38:04.067] [E/10] [info] [Task Finished] Transform to mem in 0.276769s (11098 normal rows, 43112 exceptions)
[2021-03-31 14:38:04.067] [E/3] [info] [Task Finished] Transform to mem in 0.276671s (11087 normal rows, 43044 exceptions)
[2021-03-31 14:38:04.067] [E/9] [info] [Task Finished] Transform to mem in 0.277062s (11088 normal rows, 43511 exceptions)
[2021-03-31 14:38:04.068] [E/15] [info] [Task Finished] Transform to mem in 0.277051s (11005 normal rows, 43229 exceptions)
[2021-03-31 14:38:04.069] [driver] [info] [Task Finished] Transform to mem in 0.277062s (11008 normal rows, 43017 exceptions)
[2021-03-31 14:38:04.072] [E/1] [info] [Task Finished] Transform to mem in 0.278933s (11024 normal rows, 42947 exceptions)
[2021-03-31 14:38:04.075] [E/11] [info] [Task Finished] Transform to mem in 0.278312s (11020 normal rows, 42976 exceptions)
[2021-03-31 14:38:04.341] [E/5] [info] [Task Finished] Transform to mem in 0.275543s (11036 normal rows, 42710 exceptions)
[2021-03-31 14:38:04.342] [E/13] [info] [Task Finished] Transform to mem in 0.276367s (11098 normal rows, 43115 exceptions)
[2021-03-31 14:38:04.342] [E/14] [info] [Task Finished] Transform to mem in 0.276296s (11087 normal rows, 42938 exceptions)
[2021-03-31 14:38:04.342] [E/7] [info] [Task Finished] Transform to mem in 0.276549s (11125 normal rows, 43517 exceptions)
[2021-03-31 14:38:04.343] [E/12] [info] [Task Finished] Transform to mem in 0.276242s (11052 normal rows, 42881 exceptions)
[2021-03-31 14:38:04.343] [E/4] [info] [Task Finished] Transform to mem in 0.276071s (10995 normal rows, 42708 exceptions)
[2021-03-31 14:38:04.343] [E/6] [info] [Task Finished] Transform to mem in 0.276673s (10985 normal rows, 43336 exceptions)
[2021-03-31 14:38:04.344] [E/2] [info] [Task Finished] Transform to mem in 0.277152s (11020 normal rows, 43057 exceptions)
[2021-03-31 14:38:04.344] [E/8] [info] [Task Finished] Transform to mem in 0.277533s (11000 normal rows, 42999 exceptions)
[2021-03-31 14:38:04.344] [E/9] [info] [Task Finished] Transform to mem in 0.276530s (11073 normal rows, 42970 exceptions)
[2021-03-31 14:38:04.344] [E/3] [info] [Task Finished] Transform to mem in 0.277093s (11098 normal rows, 43075 exceptions)
[2021-03-31 14:38:04.345] [E/10] [info] [Task Finished] Transform to mem in 0.277225s (11166 normal rows, 43520 exceptions)
[2021-03-31 14:38:04.346] [E/15] [info] [Task Finished] Transform to mem in 0.277164s (10999 normal rows, 43334 exceptions)
[2021-03-31 14:38:04.346] [driver] [info] [Task Finished] Transform to mem in 0.277410s (11000 normal rows, 43009 exceptions)
[2021-03-31 14:38:04.348] [E/1] [info] [Task Finished] Transform to mem in 0.276311s (11052 normal rows, 42764 exceptions)
[2021-03-31 14:38:04.353] [E/11] [info] [Task Finished] Transform to mem in 0.278070s (11020 normal rows, 43138 exceptions)
[2021-03-31 14:38:04.620] [E/5] [info] [Task Finished] Transform to mem in 0.279393s (10995 normal rows, 42726 exceptions)
[2021-03-31 14:38:04.623] [E/14] [info] [Task Finished] Transform to mem in 0.280527s (11091 normal rows, 43047 exceptions)
[2021-03-31 14:38:04.623] [E/13] [info] [Task Finished] Transform to mem in 0.280653s (11166 normal rows, 43508 exceptions)
[2021-03-31 14:38:04.623] [E/12] [info] [Task Finished] Transform to mem in 0.280451s (10999 normal rows, 43300 exceptions)
[2021-03-31 14:38:04.623] [E/7] [info] [Task Finished] Transform to mem in 0.280596s (11080 normal rows, 43031 exceptions)
[2021-03-31 14:38:04.623] [E/6] [info] [Task Finished] Transform to mem in 0.280264s (11036 normal rows, 42720 exceptions)
[2021-03-31 14:38:04.624] [E/4] [info] [Task Finished] Transform to mem in 0.281219s (11000 normal rows, 43043 exceptions)
[2021-03-31 14:38:04.624] [E/8] [info] [Task Finished] Transform to mem in 0.280240s (10995 normal rows, 42718 exceptions)
[2021-03-31 14:38:04.625] [E/2] [info] [Task Finished] Transform to mem in 0.281069s (11016 normal rows, 43165 exceptions)
[2021-03-31 14:38:04.625] [E/3] [info] [Task Finished] Transform to mem in 0.280620s (11001 normal rows, 43113 exceptions)
[2021-03-31 14:38:04.625] [E/10] [info] [Task Finished] Transform to mem in 0.280690s (11170 normal rows, 43024 exceptions)
[2021-03-31 14:38:04.626] [E/9] [info] [Task Finished] Transform to mem in 0.281792s (11186 normal rows, 43465 exceptions)
[2021-03-31 14:38:04.627] [E/15] [info] [Task Finished] Transform to mem in 0.280949s (10989 normal rows, 43282 exceptions)
[2021-03-31 14:38:04.628] [driver] [info] [Task Finished] Transform to mem in 0.281677s (11010 normal rows, 43002 exceptions)
[2021-03-31 14:38:04.629] [E/1] [info] [Task Finished] Transform to mem in 0.280827s (11002 normal rows, 42755 exceptions)
[2021-03-31 14:38:04.636] [E/11] [info] [Task Finished] Transform to mem in 0.282618s (11050 normal rows, 43199 exceptions)
[2021-03-31 14:38:04.895] [E/5] [info] [Task Finished] Transform to mem in 0.275384s (10973 normal rows, 42686 exceptions)
[2021-03-31 14:38:04.899] [E/13] [info] [Task Finished] Transform to mem in 0.276017s (11045 normal rows, 43148 exceptions)
[2021-03-31 14:38:04.899] [E/7] [info] [Task Finished] Transform to mem in 0.276128s (10997 normal rows, 43283 exceptions)
[2021-03-31 14:38:04.899] [E/14] [info] [Task Finished] Transform to mem in 0.276516s (11160 normal rows, 43455 exceptions)
[2021-03-31 14:38:04.899] [E/12] [info] [Task Finished] Transform to mem in 0.276458s (11166 normal rows, 43023 exceptions)
[2021-03-31 14:38:04.900] [E/6] [info] [Task Finished] Transform to mem in 0.276616s (11005 normal rows, 42971 exceptions)
[2021-03-31 14:38:04.900] [E/4] [info] [Task Finished] Transform to mem in 0.276103s (11007 normal rows, 42795 exceptions)
[2021-03-31 14:38:04.901] [E/8] [info] [Task Finished] Transform to mem in 0.276521s (11050 normal rows, 43196 exceptions)
[2021-03-31 14:38:04.901] [E/2] [info] [Task Finished] Transform to mem in 0.275934s (10973 normal rows, 42686 exceptions)
[2021-03-31 14:38:04.902] [E/10] [info] [Task Finished] Transform to mem in 0.276230s (11043 normal rows, 43153 exceptions)
[2021-03-31 14:38:04.902] [E/3] [info] [Task Finished] Transform to mem in 0.276554s (11160 normal rows, 43446 exceptions)
[2021-03-31 14:38:04.903] [E/9] [info] [Task Finished] Transform to mem in 0.277161s (11168 normal rows, 43028 exceptions)
[2021-03-31 14:38:04.904] [E/15] [info] [Task Finished] Transform to mem in 0.277360s (10997 normal rows, 43277 exceptions)
[2021-03-31 14:38:04.905] [driver] [info] [Task Finished] Transform to mem in 0.277285s (10997 normal rows, 42973 exceptions)
[2021-03-31 14:38:04.905] [E/1] [info] [Task Finished] Transform to mem in 0.276238s (11015 normal rows, 42799 exceptions)
[2021-03-31 14:38:04.914] [E/11] [info] [Task Finished] Transform to mem in 0.278754s (11050 normal rows, 43170 exceptions)
[2021-03-31 14:38:05.171] [E/5] [info] [Task Finished] Transform to mem in 0.275163s (10973 normal rows, 42710 exceptions)
[2021-03-31 14:38:05.175] [E/13] [info] [Task Finished] Transform to mem in 0.276270s (11160 normal rows, 43431 exceptions)
[2021-03-31 14:38:05.175] [E/7] [info] [Task Finished] Transform to mem in 0.276219s (11043 normal rows, 43166 exceptions)
[2021-03-31 14:38:05.175] [E/12] [info] [Task Finished] Transform to mem in 0.276006s (10997 normal rows, 43237 exceptions)
[2021-03-31 14:38:05.176] [E/14] [info] [Task Finished] Transform to mem in 0.276221s (11168 normal rows, 43027 exceptions)
[2021-03-31 14:38:05.176] [E/6] [info] [Task Finished] Transform to mem in 0.276516s (10997 normal rows, 43012 exceptions)
[2021-03-31 14:38:05.176] [E/4] [info] [Task Finished] Transform to mem in 0.276287s (11009 normal rows, 42805 exceptions)
[2021-03-31 14:38:05.177] [E/2] [info] [Task Finished] Transform to mem in 0.276092s (11003 normal rows, 42716 exceptions)
[2021-03-31 14:38:05.177] [E/8] [info] [Task Finished] Transform to mem in 0.276459s (11021 normal rows, 43160 exceptions)
[2021-03-31 14:38:05.178] [E/10] [info] [Task Finished] Transform to mem in 0.276271s (11165 normal rows, 43354 exceptions)
[2021-03-31 14:38:05.178] [E/3] [info] [Task Finished] Transform to mem in 0.276310s (11043 normal rows, 43217 exceptions)
[2021-03-31 14:38:05.179] [E/9] [info] [Task Finished] Transform to mem in 0.276409s (11156 normal rows, 43044 exceptions)
[2021-03-31 14:38:05.181] [E/15] [info] [Task Finished] Transform to mem in 0.276722s (11009 normal rows, 43187 exceptions)
[2021-03-31 14:38:05.181] [E/1] [info] [Task Finished] Transform to mem in 0.276123s (11009 normal rows, 42811 exceptions)
[2021-03-31 14:38:05.182] [driver] [info] [Task Finished] Transform to mem in 0.277335s (10997 normal rows, 43067 exceptions)
[2021-03-31 14:38:05.192] [E/11] [info] [Task Finished] Transform to mem in 0.277954s (11021 normal rows, 43162 exceptions)
[2021-03-31 14:38:05.449] [E/5] [info] [Task Finished] Transform to mem in 0.278592s (11003 normal rows, 42716 exceptions)
[2021-03-31 14:38:05.455] [E/13] [info] [Task Finished] Transform to mem in 0.279273s (11165 normal rows, 43260 exceptions)
[2021-03-31 14:38:05.455] [E/7] [info] [Task Finished] Transform to mem in 0.279382s (11027 normal rows, 43245 exceptions)
[2021-03-31 14:38:05.455] [E/12] [info] [Task Finished] Transform to mem in 0.279653s (11172 normal rows, 43107 exceptions)
[2021-03-31 14:38:05.456] [E/14] [info] [Task Finished] Transform to mem in 0.279820s (10997 normal rows, 43177 exceptions)
[2021-03-31 14:38:05.456] [E/4] [info] [Task Finished] Transform to mem in 0.279594s (10999 normal rows, 42828 exceptions)
[2021-03-31 14:38:05.456] [E/8] [info] [Task Finished] Transform to mem in 0.279211s (11000 normal rows, 42726 exceptions)
[2021-03-31 14:38:05.456] [E/6] [info] [Task Finished] Transform to mem in 0.280048s (11009 normal rows, 43050 exceptions)
[2021-03-31 14:38:05.456] [E/2] [info] [Task Finished] Transform to mem in 0.279696s (11031 normal rows, 43157 exceptions)
[2021-03-31 14:38:05.457] [E/10] [info] [Task Finished] Transform to mem in 0.279316s (11091 normal rows, 43230 exceptions)
[2021-03-31 14:38:05.458] [E/3] [info] [Task Finished] Transform to mem in 0.279800s (11099 normal rows, 43272 exceptions)
[2021-03-31 14:38:05.459] [E/9] [info] [Task Finished] Transform to mem in 0.279691s (11177 normal rows, 43113 exceptions)
[2021-03-31 14:38:05.460] [E/15] [info] [Task Finished] Transform to mem in 0.279753s (10997 normal rows, 43174 exceptions)
[2021-03-31 14:38:05.461] [E/1] [info] [Task Finished] Transform to mem in 0.279377s (10987 normal rows, 43020 exceptions)
[2021-03-31 14:38:05.462] [driver] [info] [Task Finished] Transform to mem in 0.280022s (11020 normal rows, 42867 exceptions)
[2021-03-31 14:38:05.507] [E/11] [info] [Task Finished] Transform to mem in 0.314197s (12330 normal rows, 48094 exceptions)
[2021-03-31 14:38:05.507] [global] [info] [Transform Stage] Stage 0 completed 160 load&transform tasks in 2.82618s
[2021-03-31 14:38:05.507] [global] [info] [Transform Stage] Stage 0 total wall clock time: 44.4618s, 56350770 input rows, time to process 1 row via fast path: 0.000789018ms
[2021-03-31 14:38:05.507] [global] [info] Exception details: 
+------------+------------+---------+
| OperatorID | Exception  | Count   |
+------------+------------+---------+
| 100001     | ValueError | 6884232 |
+------------+------------+---------+
| 100015     | ValueError | 11688   |
+------------+------------+---------+
[2021-03-31 14:38:05.511] [local ee] [info] compiled pure python pipeline in 0.004389s
[2021-03-31 14:38:05.511] [local ee] [info] creating hybrid intermediates took 0.000003s
[2021-03-31 14:38:05.512] [local ee] [info] Created 160 resolve tasks in 0.001209s
[2021-03-31 14:38:05.512] [local ee] [info] 160/160 tasks require executing the slow path.
[2021-03-31 14:39:14.026] [E/3] [info] [Task Finished] Resolve in 68.513577s
[2021-03-31 14:39:14.549] [E/7] [info] [Task Finished] Resolve in 69.036219s
[2021-03-31 14:39:15.519] [E/13] [info] [Task Finished] Resolve in 70.006421s
[2021-03-31 14:39:15.663] [driver] [info] [Task Finished] Resolve in 70.150521s
[2021-03-31 14:39:15.715] [E/10] [info] [Task Finished] Resolve in 70.202211s
[2021-03-31 14:39:18.091] [E/2] [info] [Task Finished] Resolve in 72.578830s
[2021-03-31 14:39:19.170] [E/9] [info] [Task Finished] Resolve in 73.657089s
[2021-03-31 14:39:19.174] [E/1] [info] [Task Finished] Resolve in 73.661687s
[2021-03-31 14:39:21.797] [E/12] [info] [Task Finished] Resolve in 76.284792s
[2021-03-31 14:39:21.820] [E/5] [info] [Task Finished] Resolve in 76.307938s
[2021-03-31 14:39:22.572] [E/4] [info] [Task Finished] Resolve in 77.059962s
[2021-03-31 14:39:24.847] [E/8] [info] [Task Finished] Resolve in 79.334740s
[2021-03-31 14:39:30.025] [E/14] [info] [Task Finished] Resolve in 84.512930s
[2021-03-31 14:39:34.834] [E/11] [info] [Task Finished] Resolve in 89.321678s
[2021-03-31 14:39:39.566] [E/15] [info] [Task Finished] Resolve in 94.053275s
[2021-03-31 14:39:54.423] [E/6] [info] [Task Finished] Resolve in 108.910049s
[2021-03-31 14:40:12.721] [driver] [info] [Task Finished] Resolve in 57.057554s
[2021-03-31 14:40:20.651] [E/3] [info] [Task Finished] Resolve in 66.624516s
[2021-03-31 14:40:29.636] [E/7] [info] [Task Finished] Resolve in 75.087534s
[2021-03-31 14:40:29.657] [E/10] [info] [Task Finished] Resolve in 73.942089s
[2021-03-31 14:40:33.257] [E/13] [info] [Task Finished] Resolve in 77.738207s
[2021-03-31 14:40:35.487] [E/4] [info] [Task Finished] Resolve in 72.914464s
[2021-03-31 14:40:35.522] [E/12] [info] [Task Finished] Resolve in 73.724558s
[2021-03-31 14:40:37.765] [E/5] [info] [Task Finished] Resolve in 75.944117s
[2021-03-31 14:40:37.926] [E/1] [info] [Task Finished] Resolve in 78.752177s
[2021-03-31 14:40:38.348] [E/2] [info] [Task Finished] Resolve in 80.256184s
[2021-03-31 14:40:46.209] [E/8] [info] [Task Finished] Resolve in 81.362121s
[2021-03-31 14:40:48.002] [E/9] [info] [Task Finished] Resolve in 88.832875s
[2021-03-31 14:40:49.328] [E/14] [info] [Task Finished] Resolve in 79.302783s
[2021-03-31 14:40:49.717] [E/11] [info] [Task Finished] Resolve in 74.882862s
[2021-03-31 14:40:50.204] [E/15] [info] [Task Finished] Resolve in 70.638572s
[2021-03-31 14:41:06.867] [E/6] [info] [Task Finished] Resolve in 72.444536s
[2021-03-31 14:41:21.587] [E/3] [info] [Task Finished] Resolve in 60.936655s
[2021-03-31 14:41:25.259] [driver] [info] [Task Finished] Resolve in 72.538406s
[2021-03-31 14:41:39.715] [E/7] [info] [Task Finished] Resolve in 70.078573s
[2021-03-31 14:41:49.984] [E/1] [info] [Task Finished] Resolve in 72.057256s
[2021-03-31 14:41:50.200] [E/2] [info] [Task Finished] Resolve in 71.852106s
[2021-03-31 14:41:50.942] [E/5] [info] [Task Finished] Resolve in 73.177266s
[2021-03-31 14:41:55.484] [E/12] [info] [Task Finished] Resolve in 79.962477s
[2021-03-31 14:41:56.342] [E/11] [info] [Task Finished] Resolve in 66.625073s
[2021-03-31 14:41:59.337] [E/13] [info] [Task Finished] Resolve in 86.079517s
[2021-03-31 14:42:00.153] [E/10] [info] [Task Finished] Resolve in 90.496132s
[2021-03-31 14:42:00.158] [E/4] [info] [Task Finished] Resolve in 84.670651s
[2021-03-31 14:42:05.209] [E/9] [info] [Task Finished] Resolve in 77.206569s
[2021-03-31 14:42:06.780] [E/15] [info] [Task Finished] Resolve in 76.575371s
[2021-03-31 14:42:16.231] [E/8] [info] [Task Finished] Resolve in 90.021245s
[2021-03-31 14:42:19.764] [E/6] [info] [Task Finished] Resolve in 72.896501s
[2021-03-31 14:42:20.196] [E/14] [info] [Task Finished] Resolve in 90.867833s
[2021-03-31 14:42:34.083] [driver] [info] [Task Finished] Resolve in 68.823687s
[2021-03-31 14:42:35.588] [E/3] [info] [Task Finished] Resolve in 74.001059s
[2021-03-31 14:42:51.994] [E/7] [info] [Task Finished] Resolve in 72.278764s
[2021-03-31 14:42:58.848] [E/10] [info] [Task Finished] Resolve in 58.694615s
[2021-03-31 14:43:02.649] [E/1] [info] [Task Finished] Resolve in 72.664832s
[2021-03-31 14:43:04.630] [E/5] [info] [Task Finished] Resolve in 73.688128s
[2021-03-31 14:43:08.923] [E/2] [info] [Task Finished] Resolve in 78.723754s
[2021-03-31 14:43:12.502] [E/11] [info] [Task Finished] Resolve in 76.159369s
[2021-03-31 14:43:17.287] [E/4] [info] [Task Finished] Resolve in 77.129267s
[2021-03-31 14:43:19.570] [E/9] [info] [Task Finished] Resolve in 74.360381s
[2021-03-31 14:43:21.423] [E/13] [info] [Task Finished] Resolve in 82.086092s
[2021-03-31 14:43:28.726] [E/12] [info] [Task Finished] Resolve in 93.241113s
[2021-03-31 14:43:31.584] [E/14] [info] [Task Finished] Resolve in 71.388057s
[2021-03-31 14:43:37.145] [E/15] [info] [Task Finished] Resolve in 90.365606s
[2021-03-31 14:43:40.414] [E/8] [info] [Task Finished] Resolve in 84.183318s
[2021-03-31 14:43:43.237] [E/6] [info] [Task Finished] Resolve in 83.472966s
[2021-03-31 14:43:46.969] [E/3] [info] [Task Finished] Resolve in 71.380281s
[2021-03-31 14:43:56.740] [driver] [info] [Task Finished] Resolve in 82.657050s
[2021-03-31 14:44:02.203] [E/7] [info] [Task Finished] Resolve in 70.209108s
[2021-03-31 14:44:08.859] [E/1] [info] [Task Finished] Resolve in 66.210385s
[2021-03-31 14:44:16.350] [E/10] [info] [Task Finished] Resolve in 77.502328s
[2021-03-31 14:44:23.858] [E/11] [info] [Task Finished] Resolve in 71.356189s
[2021-03-31 14:44:28.740] [E/5] [info] [Task Finished] Resolve in 84.109501s
[2021-03-31 14:44:30.333] [E/2] [info] [Task Finished] Resolve in 81.409289s
[2021-03-31 14:44:36.972] [E/13] [info] [Task Finished] Resolve in 75.549004s
[2021-03-31 14:44:40.567] [E/9] [info] [Task Finished] Resolve in 80.997442s
[2021-03-31 14:44:43.513] [E/15] [info] [Task Finished] Resolve in 66.367581s
[2021-03-31 14:44:44.675] [E/4] [info] [Task Finished] Resolve in 87.388421s
[2021-03-31 14:44:48.738] [E/14] [info] [Task Finished] Resolve in 77.153966s
[2021-03-31 14:44:49.754] [E/12] [info] [Task Finished] Resolve in 81.027971s
[2021-03-31 14:44:51.618] [E/3] [info] [Task Finished] Resolve in 64.648775s
[2021-03-31 14:44:56.225] [E/6] [info] [Task Finished] Resolve in 72.988207s
[2021-03-31 14:45:05.173] [driver] [info] [Task Finished] Resolve in 68.432856s
[2021-03-31 14:45:07.010] [E/8] [info] [Task Finished] Resolve in 86.595546s
[2021-03-31 14:45:18.364] [E/1] [info] [Task Finished] Resolve in 69.504943s
[2021-03-31 14:45:28.323] [E/7] [info] [Task Finished] Resolve in 86.120283s
[2021-03-31 14:45:35.021] [E/5] [info] [Task Finished] Resolve in 66.281710s
[2021-03-31 14:45:39.210] [E/11] [info] [Task Finished] Resolve in 75.351824s
[2021-03-31 14:45:41.322] [E/10] [info] [Task Finished] Resolve in 84.971993s
[2021-03-31 14:45:45.038] [E/2] [info] [Task Finished] Resolve in 74.705209s
[2021-03-31 14:45:51.962] [E/13] [info] [Task Finished] Resolve in 74.989804s
[2021-03-31 14:45:58.213] [E/4] [info] [Task Finished] Resolve in 73.537331s
[2021-03-31 14:45:58.424] [E/15] [info] [Task Finished] Resolve in 74.910658s
[2021-03-31 14:46:02.236] [E/9] [info] [Task Finished] Resolve in 81.669291s
[2021-03-31 14:46:03.435] [E/3] [info] [Task Finished] Resolve in 71.817130s
[2021-03-31 14:46:04.333] [E/14] [info] [Task Finished] Resolve in 75.594283s
[2021-03-31 14:46:05.757] [E/12] [info] [Task Finished] Resolve in 76.003407s
[2021-03-31 14:46:12.582] [E/6] [info] [Task Finished] Resolve in 76.356764s
[2021-03-31 14:46:15.969] [E/8] [info] [Task Finished] Resolve in 68.959216s
[2021-03-31 14:46:29.693] [driver] [info] [Task Finished] Resolve in 84.520384s
[2021-03-31 14:46:41.551] [E/5] [info] [Task Finished] Resolve in 66.529799s
[2021-03-31 14:46:47.258] [E/7] [info] [Task Finished] Resolve in 78.934402s
[2021-03-31 14:46:47.402] [E/1] [info] [Task Finished] Resolve in 89.037955s
[2021-03-31 14:46:56.237] [E/10] [info] [Task Finished] Resolve in 74.914666s
[2021-03-31 14:47:03.211] [E/2] [info] [Task Finished] Resolve in 78.173389s
[2021-03-31 14:47:05.843] [E/13] [info] [Task Finished] Resolve in 73.881060s
[2021-03-31 14:47:06.590] [E/15] [info] [Task Finished] Resolve in 68.166195s
[2021-03-31 14:47:13.277] [E/11] [info] [Task Finished] Resolve in 94.066922s
[2021-03-31 14:47:15.485] [E/3] [info] [Task Finished] Resolve in 72.050163s
[2021-03-31 14:47:15.552] [E/4] [info] [Task Finished] Resolve in 77.339625s
[2021-03-31 14:47:19.412] [E/9] [info] [Task Finished] Resolve in 77.175282s
[2021-03-31 14:47:21.789] [E/14] [info] [Task Finished] Resolve in 77.456173s
[2021-03-31 14:47:28.012] [E/12] [info] [Task Finished] Resolve in 82.255493s
[2021-03-31 14:47:36.663] [E/6] [info] [Task Finished] Resolve in 84.080884s
[2021-03-31 14:47:36.987] [E/8] [info] [Task Finished] Resolve in 81.018051s
[2021-03-31 14:47:48.974] [E/7] [info] [Task Finished] Resolve in 61.716320s
[2021-03-31 14:47:52.378] [driver] [info] [Task Finished] Resolve in 82.684925s
[2021-03-31 14:48:09.404] [E/1] [info] [Task Finished] Resolve in 82.002504s
[2021-03-31 14:48:10.408] [E/13] [info] [Task Finished] Resolve in 64.564784s
[2021-03-31 14:48:13.059] [E/5] [info] [Task Finished] Resolve in 91.507539s
[2021-03-31 14:48:14.183] [E/15] [info] [Task Finished] Resolve in 67.592815s
[2021-03-31 14:48:16.856] [E/10] [info] [Task Finished] Resolve in 80.619185s
[2021-03-31 14:48:21.775] [E/2] [info] [Task Finished] Resolve in 78.563699s
[2021-03-31 14:48:22.492] [E/11] [info] [Task Finished] Resolve in 69.215824s
[2021-03-31 14:48:22.741] [E/3] [info] [Task Finished] Resolve in 67.256412s
[2021-03-31 14:48:29.051] [E/4] [info] [Task Finished] Resolve in 73.499056s
[2021-03-31 14:48:34.290] [E/14] [info] [Task Finished] Resolve in 72.501632s
[2021-03-31 14:48:41.851] [E/12] [info] [Task Finished] Resolve in 73.838831s
[2021-03-31 14:48:42.812] [E/6] [info] [Task Finished] Resolve in 66.148968s
[2021-03-31 14:48:49.824] [E/9] [info] [Task Finished] Resolve in 90.412641s
[2021-03-31 14:48:52.444] [driver] [info] [Task Finished] Resolve in 60.066089s
[2021-03-31 14:49:00.146] [E/8] [info] [Task Finished] Resolve in 83.159099s
[2021-03-31 14:49:03.317] [E/7] [info] [Task Finished] Resolve in 74.343306s
[2021-03-31 14:49:28.577] [E/13] [info] [Task Finished] Resolve in 78.169128s
[2021-03-31 14:49:32.920] [E/10] [info] [Task Finished] Resolve in 76.063889s
[2021-03-31 14:49:33.681] [E/1] [info] [Task Finished] Resolve in 84.276175s
[2021-03-31 14:49:36.341] [E/15] [info] [Task Finished] Resolve in 82.157771s
[2021-03-31 14:49:38.013] [E/3] [info] [Task Finished] Resolve in 75.271668s
[2021-03-31 14:49:39.713] [E/5] [info] [Task Finished] Resolve in 86.654140s
[2021-03-31 14:49:44.256] [E/11] [info] [Task Finished] Resolve in 81.763613s
[2021-03-31 14:49:44.886] [E/4] [info] [Task Finished] Resolve in 75.834114s
[2021-03-31 14:49:49.033] [E/12] [info] [Task Finished] Resolve in 67.182097s
[2021-03-31 14:49:50.043] [driver] [info] [Task Finished] Resolve in 57.598720s
[2021-03-31 14:49:55.079] [E/2] [info] [Task Finished] Resolve in 93.303428s
[2021-03-31 14:50:05.679] [E/14] [info] [Task Finished] Resolve in 91.388181s
[2021-03-31 14:50:05.919] [E/6] [info] [Task Finished] Resolve in 83.107194s
[2021-03-31 14:50:14.103] [E/8] [info] [Task Finished] Resolve in 73.957146s
[2021-03-31 14:50:16.850] [E/9] [info] [Task Finished] Resolve in 87.025570s
[2021-03-31 14:50:25.914] [E/13] [info] [Task Finished] Resolve in 57.337424s
[2021-03-31 14:50:26.065] [E/7] [info] [Task Finished] Resolve in 82.748136s
[2021-03-31 14:50:33.301] [E/10] [info] [Task Finished] Resolve in 60.381368s
[2021-03-31 14:50:39.329] [E/4] [info] [Task Finished] Resolve in 54.443690s
[2021-03-31 14:50:40.574] [E/3] [info] [Task Finished] Resolve in 62.560762s
[2021-03-31 14:50:41.856] [E/15] [info] [Task Finished] Resolve in 65.514937s
[2021-03-31 14:50:44.212] [E/5] [info] [Task Finished] Resolve in 64.498663s
[2021-03-31 14:50:47.349] [E/1] [info] [Task Finished] Resolve in 73.668716s
[2021-03-31 14:50:48.101] [E/12] [info] [Task Finished] Resolve in 59.067530s
[2021-03-31 14:50:48.949] [driver] [info] [Task Finished] Resolve in 58.906206s
[2021-03-31 14:50:49.711] [E/14] [info] [Task Finished] Resolve in 44.032767s
[2021-03-31 14:50:50.980] [E/11] [info] [Task Finished] Resolve in 66.723685s
[2021-03-31 14:50:51.933] [E/6] [info] [Task Finished] Resolve in 46.014178s
[2021-03-31 14:50:52.049] [E/2] [info] [Task Finished] Resolve in 56.970093s
[2021-03-31 14:50:52.049] [local ee] [info] slow path resolved 6895920/6895920 exceptions in 766.542s
[2021-03-31 14:50:52.049] [local ee] [info] slow path for Stage 0: total wall clock time: 12063.1s, time to process 1 row via slow path: 1.74931ms
[2021-03-31 14:50:52.049] [global] [info] [Transform Stage] Stage 0 completed 160 resolve tasks in 766.542s

[2021-03-31 14:50:52.049] [global] [info] Writing 1798491 rows as output to file (273.61 MB)
[2021-03-31 14:50:52.064] [E/9] [info] [Task Finished] write to file in 0.014507s (46082 rows, 7.01 MB)
[2021-03-31 14:50:52.082] [E/7] [info] [Task Finished] write to file in 0.032284s (112421 rows, 17.10 MB)
[2021-03-31 14:50:52.082] [E/14] [info] [Task Finished] write to file in 0.032747s (112425 rows, 17.10 MB)
[2021-03-31 14:50:52.082] [E/5] [info] [Task Finished] write to file in 0.032901s (112438 rows, 17.10 MB)
[2021-03-31 14:50:52.082] [E/12] [info] [Task Finished] write to file in 0.033040s (112583 rows, 17.13 MB)
[2021-03-31 14:50:52.082] [E/6] [info] [Task Finished] write to file in 0.033137s (112459 rows, 17.11 MB)
[2021-03-31 14:50:52.082] [E/13] [info] [Task Finished] write to file in 0.033133s (112573 rows, 17.12 MB)
[2021-03-31 14:50:52.082] [E/10] [info] [Task Finished] write to file in 0.033179s (112482 rows, 17.11 MB)
[2021-03-31 14:50:52.083] [E/3] [info] [Task Finished] write to file in 0.033333s (112467 rows, 17.11 MB)
[2021-03-31 14:50:52.084] [driver] [info] [Task Finished] write to file in 0.034539s (123251 rows, 18.75 MB)
[2021-03-31 14:50:52.084] [E/15] [info] [Task Finished] write to file in 0.034616s (123410 rows, 18.78 MB)
[2021-03-31 14:50:52.084] [E/4] [info] [Task Finished] write to file in 0.034630s (123377 rows, 18.77 MB)
[2021-03-31 14:50:52.084] [E/1] [info] [Task Finished] write to file in 0.034743s (123389 rows, 18.77 MB)
[2021-03-31 14:50:52.084] [E/11] [info] [Task Finished] write to file in 0.034740s (123424 rows, 18.78 MB)
[2021-03-31 14:50:52.084] [E/8] [info] [Task Finished] write to file in 0.034760s (123299 rows, 18.76 MB)
[2021-03-31 14:50:52.085] [E/2] [info] [Task Finished] write to file in 0.035869s (112411 rows, 17.10 MB)
[2021-03-31 14:50:52.085] [global] [info] writing output took 0.036212s
[2021-03-31 14:50:52.085] [global] [info] [Transform Stage] Stage 0 completed 160 sink tasks in 0.0363005s
[2021-03-31 14:50:52.085] [global] [info] [Transform Stage] Stage 0 took 769.91s
[2021-03-31 14:50:52.085] [global] [info] Query Execution took 769.99s. (planning: 0.079733s, execution: 769.91s)
Welcome to

  _____            _
 |_   _|   _ _ __ | | _____  __
   | || | | | '_ \| |/ _ \ \/ /
   | || |_| | |_) | |  __/>  <
   |_| \__,_| .__/|_|\___/_/\_\ 0.1.7
            |_|
    
using Python 3.6.9 (default, Mar 31 2021, 12:55:20) 
[GCC 10.2.0] on linux
>>> running tuplex on ['/data/zillow/Zdirty/zillow_dirty@10G.csv']
>>> bug in generated parser, force to false
Tuplex startup time: 0.005459785461425781
>>> running pipeline with Tuplex resolvers...
Tuplex job time: 770.2725365161896 s
{'tuplex.useLLVMOptimizer': True, 'tuplex.autoUpcast': False, 'tuplex.allowUndefinedBehavior': False, 'tuplex.optimizer.codeStats': False, 'tuplex.optimizer.generateParser': False, 'tuplex.optimizer.nullValueOptimization': False, 'tuplex.optimizer.filterPushdown': True, 'tuplex.optimizer.sharedObjectPropagation': True, 'tuplex.interleaveIO': True, 'tuplex.resolveWithInterpreterOnly': True, 'tuplex.csv.selectionPushdown': True, 'tuplex.webui.enable': False, 'tuplex.executorCount': 15, 'tuplex.csv.maxDetectionRows': 10000, 'tuplex.webui.port': 5000, 'tuplex.webui.mongodb.port': 27017, 'tuplex.webui.exceptionDisplayLimit': 5, 'tuplex.normalcaseThreshold': 0.9, 'tuplex.csv.comments': ['#', '~'], 'tuplex.csv.maxDetectionMemory': '256KB', 'tuplex.csv.quotechar': '"', 'tuplex.csv.separators': [',', ';', '|', '\t'], 'tuplex.driverMemory': '10G', 'tuplex.env.hostname': '499bbd619a75', 'tuplex.env.mode': 'file', 'tuplex.env.user': 'root', 'tuplex.executorMemory': '6G', 'tuplex.inputSplitSize': '64MB', 'tuplex.logDir': '.', 'tuplex.optimizer.mergeExceptionsInOrder': 'False', 'tuplex.optimizer.operatorReordering': 'false', 'tuplex.optionalThreshold': '0.7', 'tuplex.partitionSize': '32MB', 'tuplex.readBufferSize': '128KB', 'tuplex.runTimeLibrary': '/usr/local/lib/python3.6/site-packages/Tuplex-0.1.7-py3.6.egg/tuplex/libexec/tuplex_runtime', 'tuplex.runTimeMemory': '64MB', 'tuplex.runTimeMemoryBlockSize': '4MB', 'tuplex.scratchDir': '/tmp', 'tuplex.webui.mongodb.path': '/data/tuplex_history', 'tuplex.webui.mongodb.url': 'localhost', 'tuplex.webui.url': 'localhost'}
{"logical_optimization_time_s":0.0227508,"llvm_optimization_time_s":0.334691,"llvm_compilation_time_s":0.153151,"total_compilation_time_s":0.505566,"sampling_time_s":0.109339,"stages":[{"stage_no":0,"fast_path_wall_time_s":44.4618,"fast_path_time_s":2.8262,"fast_path_per_row_time_ns":789.018,"slow_path_wall_time_s":12063.1,"slow_path_time_s":766.542,"slow_path_per_row_time_ns":1.74931e+06}]}
{"webui.enable": false, "executorMemory": "6G", "executorCount": 15, "driverMemory": "10G", "partitionSize": "32MB", "runTimeMemory": "64MB", "inputSplitSize": "64MB", "useLLVMOptimizer": true, "optimizer.nullValueOptimization": false, "csv.selectionPushdown": true, "optimizer.generateParser": false, "optimizer.mergeExceptionsInOrder": false, "optimizer.filterPushdown": true, "resolveWithInterpreterOnly": true}
{"startupTime": 0.005459785461425781, "jobTime": 770.2725365161896, "mode": "resolve", "mergeExceptionsInOrder": false}
[2021-03-31 14:51:00.298] [local execution engine] [info] Stopped local executor E/1
[2021-03-31 14:51:00.303] [local execution engine] [info] Stopped local executor E/2
[2021-03-31 14:51:00.308] [local execution engine] [info] Stopped local executor E/3
[2021-03-31 14:51:00.314] [local execution engine] [info] Stopped local executor E/4
[2021-03-31 14:51:00.319] [local execution engine] [info] Stopped local executor E/5
[2021-03-31 14:51:00.324] [local execution engine] [info] Stopped local executor E/6
[2021-03-31 14:51:00.329] [local execution engine] [info] Stopped local executor E/7
[2021-03-31 14:51:00.334] [local execution engine] [info] Stopped local executor E/8
[2021-03-31 14:51:00.339] [local execution engine] [info] Stopped local executor E/9
[2021-03-31 14:51:00.344] [local execution engine] [info] Stopped local executor E/10
[2021-03-31 14:51:00.349] [local execution engine] [info] Stopped local executor E/11
[2021-03-31 14:51:00.354] [local execution engine] [info] Stopped local executor E/12
[2021-03-31 14:51:00.359] [local execution engine] [info] Stopped local executor E/13
[2021-03-31 14:51:00.364] [local execution engine] [info] Stopped local executor E/14
[2021-03-31 14:51:00.369] [local execution engine] [info] Stopped local executor E/15
[GLOBAL] Local engine terminated.
[GLOBAL] releasing 1 active partitions
