filepaths

package

v0.6.2 Latest Latest Go to latest Published: Jul 24, 2025 License: AGPL-3.0 Imports: 12 Imported by: 0

Details

View Source

const TempParquetExtension = ".parquet.tmp"

This section is empty.

func CleanupCollectionTempDirs()

func EnsureCollectionTempDir() string

func GetParquetFileGlobForPartition(dataDir, tableName, partitionName, fileRoot string) string

func GetParquetFileGlobForTable(dataDir, tableName, fileRoot string) string

func GetParquetPartitionPath(dataDir, tableName, partitionName string) string

func GetTempAndInvalidParquetFileGlobForPartition(dataDir, tableName, partitionName string) string

GetTempAndInvalidParquetFileGlobForPartition returns a glob pattern for invalid and temporary parquet files for a partition

func GetTempParquetFileGlobForPartition(dataDir, tableName, partitionName, fileRoot string) string

func InvalidParquetFilePath() string

func PruneTree(folder string) error

PruneTree recursively deletes empty directories in the given folder.

func TailpipeDbFilePath() string

type PartitionFields struct {
	Table     string
	Partition string
	Date      time.Time
	Index     int
}

PartitionFields represents the components of a parquet file path

func ExtractPartitionFields(parquetFilePath string) (PartitionFields, error)

ExtractPartitionFields parses a parquet file path and returns its components. Expected path format:

/path/to/dir/tp_table=<table_name>/tp_partition=<partition_id>/tp_date=<YYYY-MM-DD>/tp_index=<index>/file.parquet

Rules: