Fivetran introduces Metadata API – enables end-to-end data analysis and visibility
September 2022 by Patrick LEBRETON
Enterprises can track entire data lineage in data catalogues to meet complex compliance requirements and empower global teams to access the right data securely
Fivetran announce the availability of Fivetran’s Metadata API to enable the tracking of data "in-flight" from source to destination as it moves through Fivetran-managed pipelines. With this additional visibility, customers can integrate with governance and observability tools to give data teams more control over who has access to what data. Enabling automated data governance, the Fivetran Metadata API also provides data stewards, security teams and data engineering teams the needed visibility to answer where the data came from, who accessed it, and what changes have occurred in the pipeline.
Complex legislation such as Europe’s GDPR, the California Consumer Privacy Act (CCPA), and other state laws impose fines on companies that do not comply with complex rules to safeguard data privacy. The Fivetran Metadata API helps enterprises address compliance requirements, easily integrating into their existing privacy and security strategies while bolstering the value of investments they’ve made in data catalogues and data quality solutions.
With the Fivetran Metadata API:
– Data analysts are provided with a deep understanding of where data is coming from and are able to run impact analyses on it
– Data stewards know end users have access to data that has been handled securely and is compliant with governance requirements
– Security and legal teams can complete security audits and ensure the data moved is in compliance with organisational policies
– Data architects and engineers will soon be able to understand upstream schema changes and ensure downstream processes are updated.
Creating an automated data governance experience – Fivetran partners with leading data catalogues
Fivetran is excited to launch better metadata management with four leading data catalogue vendors: Atlan, data.world, Alation and Collibra. Here are the combined benefits:
– Information about all data can be consolidated into a single data catalogue, for a complete view and seamless user experience
– End-to-end data lineage graphs are available for data, despite data passing through multiple systems and tools
– By centralising governance in a single tool, data stewards can better ensure policies and processes are being applied to data as necessary
– The ability to source trace data at a column level back to its origin helps confirm data quality and builds trust that the data is accurate and safe to use.