Grokking the Data Engineering Interview
0% completed
Retention Lineage and Audit
A telehealth company's privacy policy has one line about appointment records: each record is kept for 365 days after the visit and then deleted. That line guarantees that the company has decided on a period. It does not delete anything, because a row stays until a job removes it. It does not cover copies in other tables, and it does not show anyone, a year later, that the deletion happened.
Three practices deal with these problems. A scheduled job deletes rows when their period ends (a retention job). A record of which datasets are built from which (lineage) finds the copies
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%