Data Ingestion
Are customers or vendors sharing data with you? When new data is shared, do downstream systems break? In my career, receiving shared data from outside my organization has often caused problems.
Dolt allows you to assert greater control over the shared data you are ingesting into your team. If you ingest bad data, roll back to the previous version. Look at the problematic diff and often the problem and solution will be obvious. Were you only expecting new data from the past day but the vendor updated last month's data as well? You can even automate these tests with tools like Great Expectations which integrates well with Dolt.
Dolt is the database for data ingestion.
Last modified 1mo ago
Export as PDF
Copy link
Edit on GitHub