processor

package

v1.1.2 Latest Latest Go to latest Published: Jul 30, 2024 License: MIT Imports: 8 Imported by: 0

Documentation ¶

This section is empty.

This section is empty.

This section is empty.

type BufferedCSVWriter struct {
	// contains filtered or unexported fields
}

BufferedCSVWriter implements DataProcessor interface

func NewBufferedCSVWriter(filename string, bufferSize int, flushInterval time.Duration) (*BufferedCSVWriter, error)

NewBufferedCSVWriter creates a new BufferedCSVWriter

func (w *BufferedCSVWriter) Close() error

Close flushes any remaining data and closes the CSV file

func (w *BufferedCSVWriter) GetBufferSize() int

GetBufferSize returns the current size of the buffer

func (w *BufferedCSVWriter) GetProcessedCount() int

GetProcessedCount returns the number of processed messages

func (w *BufferedCSVWriter) Process(data models.FormattedData)

Process implements the DataProcessor interface

type DataProcessor interface {
	Process(data models.FormattedData)
	GetProcessedCount() int
	GetBufferSize() int
}

DataProcessor interface for the Observer pattern

type PGWriter struct {
	// contains filtered or unexported fields
}

PGWriter implements DataProcessor interface for PostgreSQL

func NewPGWriter(db *sql.DB) (*PGWriter, error)

NewPGWriter creates a new PGWriter

func (w *PGWriter) Close() error

Close closes the PostgreSQL connection

func (w *PGWriter) GetBufferSize() int

GetBufferSize returns the current size of the buffer (always 0 for immediate insert)

func (w *PGWriter) GetProcessedCount() int

GetProcessedCount returns the number of processed messages

func (w *PGWriter) Process(data models.FormattedData)

Process implements the DataProcessor interface