Grokking the Data Engineering Interview
Vote

0% completed

​

Retention Lineage and Audit

A telehealth company's privacy policy has one line about appointment records: each record is kept for 365 days after the visit and then deleted. That line guarantees that the company has decided on a period. It does not delete anything, because a row stays until a job removes it. It does not cover copies in other tables, and it does not show anyone, a year later, that the deletion happened.

Three practices deal with these problems. A scheduled job deletes rows when their period ends (a retention job). A record of which datasets are built from which (lineage) finds the copies

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%


Vote for new content