Changelog • connector.databricks

connector.databricks (development version)

CRAN release: 2026-10-28

Add new class ConnectorDatabricksSQL which uses brickster::DatabricksSQL() as a driver. This class will replace ConnectorDatabricksTable as preferred way of working with tables in Databricks. This driver will be using SQL Warehouse instead of Compute Cluster, which was used by odbc driver.
connector_databricks_sql() and ConnectorDatabricksSQL are no longer marked as experimental.
README, getting started vignette and the example configuration in inst/config/example_yaml.yaml now use connector_databricks_sql(). The reading and writing article covers ConnectorDatabricksSQL, a new article compares ConnectorDatabricksSQL and ConnectorDatabricksTable, and a new authentication article explains how brickster and odbc find credentials locally, on Posit Workbench and on Posit Connect #104.
connector_databricks_table() and ConnectorDatabricksTable$new() gain ..., passed on to DBI::dbConnect() for the odbc::databricks() driver, so driver parameters such as workspace, uid, pwd or useNativeQuery can be set #109. extra_class now has to be passed by name.
Update dependency on brickster version >= 0.2.14.
Fix #105 list_content_cnt() for ConnectorDatabricksTable returning NULL with brickster >= 0.2.14, where db_uc_tables_list() now returns a paginated response with a tables element. Results from all pages are now collected.
Fix #99 support for working with volumes with read-only permissions.

CRAN release: 2025-09-05

Fix naming convention in upload_directory_cnt.DatabricksVolume #84
Added Connecting to cluster, please wait.. as a zephyr::msg_info prior to initialization of table and volume connection
Set dependency brickster (>= 0.2.7)
Add github templates for issues, features and PRs
Updated volume_methods to use zephyr::msg_info(), replacing cli::cli_alert()
Updated volume_methods, table_utils and table_methods to use zephyr::get_option() replacing a bool
Updated tests to use zephyr-option, with verbosity = quiet
Fix bug regarding empty tables #73
Fix tmp volume bug #63
Add upload_directory_cnt() and download_directory_cnt() methods for ConnectorDatabricksVolume class. Solves #77
Update remove_directory_cnt() method for ConnectorDatabricksVolume class, now iterates over directories and erases all the subdirectories and files. Solves #78
Update connector dependency to 0.1.0 official CRAN version.

Update write_cnt() to use temporary volume solution, in order to allow upload of bigger files.
Update list_content_cnt() to use tags when listing tables in Databricks.
Update read_cnt() to allow users to search tables using either timepoint or version parameter.
Remove DatabricksClient() and replace table and volume methods with brickster methods.

Minor tweaks to the DESCRIPTION file. Removed references to ‘external’ non-CRAN GitHub packages.

Major renaming: connector_databricks_dbi is now ConnectorDatabricksTable. This affects several methods and functions throughout the package.
A wrapper function has been added for better consistency with other connector packages connector_databricks_table
The dependency on connector has been updated to use 0.0.8

Refactored API for better consistency with the connector package.
Updated methods for list_content_cnt, log_read_connector, log_write_connector, and log_remove_connector to use the new structure.