How to remove Delta files and logs after 90 days in Unity Catalog?
HOTSPOT
You have an Azure Databricks workspace that is enabled for Unity Catalog.
You need to implement a data lifecycle and expiration solution that meets the following requirements:
Transaction logs and deleted data files that are older than 90 days must be removed from Delta tables to reclaim storage.
All the tables must remain available for querying during the cleanup process.
Administrative effort must be minimized.
What should you do for each requirement? To answer, select the appropriate options in the answer area.
NOTE: Each correct selection is worth one point.
Community Insight
Tests Delta Lake retention properties versus VACUUM, and the trap is choosing delta.logRetentionDuration when the dropdown allows only one property and the cleanup mechanism must actually reclaim deleted data files.
This DP-750 hotspot asks you to choose the Delta table property and cleanup mechanism for removing deleted files and transaction logs after 90 days in Azure Databricks Unity Catalog. The answer is delta.deletedFileRetentionDuration set to 90 days plus VACUUM, keeping tables online while reclaiming storage.
The common mistake is selecting delta.logRetentionDuration because transaction logs are mentioned, but that property alone does not remove deleted data files; the exam couples deletedFileRetentionDuration with VACUUM.
Community Discussion (2 comments)
Comments & Corrections
No comments yet — spotted an error or have a note? Share it below.
Expert Analysis
Why the Answer Is Correct
Settingdelta.deletedFileRetentionDuration to 90 days ensures that deleted data files are retained for 90 days before VACUUM can remove them, matching the storage-reclamation requirement. VACUUM runs online and does not make the table unavailable to queries, satisfying the availability constraint. Because VACUUM is a built-in Delta command and the retention threshold can be table-scoped, administrative effort stays low. Transaction-log cleanup is handled separately by Delta's log retention and checkpointing behavior, so the selectable property that directly controls deleted-file cleanup is deletedFileRetentionDuration.Why Other Candidate Answers Are Wrong
Choosingdelta.logRetentionDuration addresses transaction log files but does not by itself remove the deleted data files that consume table storage; it also does not satisfy the second dropdown's cleanup mechanism. Selecting delta.deletedFileRetentionDuration but pairing it with OPTIMIZE would compact files, not remove unreferenced data older than 90 days. Using VACUUM with an aggressive retention or manual file deletion would remove files too soon or increase administrative effort and risk. Only deletedFileRetentionDuration with VACUUM keeps tables queryable while removing deleted files after the 90-day threshold.Community Comment Notes
As dgerok noted, "logRetentionDuration is needed because the requirement also mentions transaction logs", but the first dropdown permits only one property, so the exam points to deletedFileRetentionDuration with VACUUM. Another learner (zxc01) observed that "both of them cannot match default value", meaning a real-world implementation might set both delta.deletedFileRetentionDuration and delta.logRetentionDuration to 90 days. The community consensus shows that the exam's single-property limitation makes deletedFileRetentionDuration the intended selection. This is a useful reminder that community reasoning can identify real-world nuances while still confirming the vendor's exam expectation.Official Reference
Exam Strategy
Treat the two dropdowns as a matched pair: the property controls when VACUUM may delete files, and the mechanism must actually remove data. If a dropdown lists a single retention property, pick the one tied to VACUUM, not log retention, unless both can be chosen.
Frequently Asked Questions
Why not set delta.logRetentionDuration to 90 days for the transaction logs?
The hotspot allows only one property; delta.deletedFileRetentionDuration is the one that lets VACUUM reclaim deleted data files. Log retention can be managed separately.
Does VACUUM make a Delta table unavailable while it runs?
No. VACUUM runs online and readers can query the table; unreferenced files are removed after the retention threshold.