gfw.common.beam.transforms.FakeParquetSink#

class FakeParquetSink(schema, codec='snappy')[source]#

A no-op ParquetSink for testing.

Discards all data without writing. Inject via sink_factory on WritePartitionedParquet to exercise windowing, partitioning, and file-naming logic without touching the filesystem.

Methods

create_metadata

flush

Write all buffered rows as a single row group and close the writer.

open

Open the Parquet writer and initialise the row buffer.

write

Buffer one keyed row for writing.

open(fh)[source]#

Open the Parquet writer and initialise the row buffer.

write(element)[source]#

Buffer one keyed row for writing.

flush()[source]#

Write all buffered rows as a single row group and close the writer.