RecordWriter

class parquetranger.RecordWriter(trepo: parquetranger.core.TableRepo, record_limit: int = 1000000, writer_function: Callable = <function TableRepo.extend at 0x7f2e2bef2dd0>, batch: list = <factory>)

Bases: object

Attributes Summary

`record_count`
`record_limit`
`written_count`

Methods Summary

`add_to_batch`(element)
`close`()
`writer_function`(df)

Attributes Documentation

record_count: int = 0

record_limit: int = 1000000

written_count: int = 0

Methods Documentation

add_to_batch(element)

close()

writer_function(df: DataFrame)