databricks

package

v0.1.19 Latest Latest Go to latest Published: Aug 26, 2025 License: MIT Imports: 18 Imported by: 0

Details

View Source

const TableName = "EXECUTE_DOCUMENTS"

This section is empty.

This section is empty.

type Config struct {
	DSN      string
	Host     string
	HttpPath string
	Token    string
	Catalog  string // optional
	Schema   string // optional
}

type Databricks struct {
	// contains filtered or unexported fields
}

func NewDatabricks(dsn string, chunkSize int) (*Databricks, error)

func (d *Databricks) CreateViews(data execute.RootSchema) error

func (d *Databricks) Prune() error

func (d *Databricks) Upload(batch_date string, nextRecord func() (map[string]interface{}, error)) (int, error)

Upload implements the Database interface. It serializes records to CSV (like Snowflake), uploads to DBFS, and loads into the Databricks table.