Sparklyr 1.9.0

Improvements

• Adds support for Spark 4 and Scala 2.13 (#3479):

  • Adds new Java folder for Spark 4.0.0 with updated code

  • Adds new JAR file to handle Spark 4+

  • Updates to different spots in the R code to start handling version 4,
    as well as releases marked as "preview" by the Spark project

  • Removes JARs using Scala 2.11

• Updates the Spark versions to use for CI

Fixes

• sdf_sql() now returns nothing, including an error, when the query outputs an
  empty dataset (#3439)

What's Changed

• Fixes #3439 by @edgararuiz in #3440
• Fix warnings with dbplyr and raw columns by @gregleleu in #3454
• CI updates by @edgararuiz in #3458
• fix: src_databases,column with name 'databaseName' cannot be resolved by @weichisyu in #3460
• Adds support for Spark 4.0 by @edgararuiz in #3479
• Spark 4.0 and Scala 2.13 support - part deux by @edgararuiz in #3481
• captures multi line errors by @jmbarbone in #3475
• Updates by @edgararuiz in #3482

New Contributors

• @weichisyu made their first contribution in #3460
• @jmbarbone made their first contribution in #3475

Full Changelog: v1.8.6...v1.9.0