{"id":5124,"date":"2022-07-15T20:26:50","date_gmt":"2022-07-16T04:26:50","guid":{"rendered":"https:\/\/www.gudusoft.com\/?p=5124"},"modified":"2022-07-15T20:26:50","modified_gmt":"2022-07-16T04:26:50","slug":"best-open-source-data-catalog-tools","status":"publish","type":"post","link":"https:\/\/www.gudusoft.com\/fr\/best-open-source-data-catalog-tools\/","title":{"rendered":"Les 4 meilleurs outils de catalogue de donn\u00e9es open source \u00e0 consid\u00e9rer en 2022"},"content":{"rendered":"

4 Best Open Source Data Catalog Tools in 2022<\/h2>\n

Fundamentally, any data-driven organization needs data catalog tools<\/strong><\/a>. Catalogues de donn\u00e9es<\/a><\/strong> help create a single environment from which all of an organization’s data and context about that data can be accessed, ensuring that organizations can reduce their insight time and quickly make high-quality data-driven business decisions. If you are looking for the best open source data catalog tools<\/strong>, then you’ve come to the right place. In this post, we’ve compiled a list of the best open source data catalog tools in 2022<\/strong> to make your life easier.<\/p>\n

\"Best

Best Open Source Data Catalog Tools<\/p><\/div>\n

Best Open Source Data Catalog Tools – 1. Apache Atlas<\/h3>\n

As an open source gestion des m\u00e9tadonn\u00e9es<\/a><\/strong> tool and governance platform, Apache Atlas is incubated by Hortonworks under the umbrella of the Data Governance Initiative.<\/p>\n

It joined the Apache Foundation Incubator in 2015 and grew to a top program in 2017. Apache Atlas is widely recognized as one of the building blocks of modern data platforms because of its early vision of using metadata to solve the challenges of data cataloging, sorting, discovery, governance, and collaboration.<\/p>\n

Main capabilities of Apache Atlas:<\/p>\n

    \n
  1. Metadata classification:<\/strong> Apache Atlas enables you to automatically classify PII, sensitive data, and other sensitive data. Data assets can be associated with multiple classifications. These policies are also propagated through lineage to ensure that derived data inherits the same classification and security controls.<\/li>\n
  2. Metadata types and instances:<\/strong> According to the Apache documentation, a “type” is a definition of how a specific type of metadata object is stored and accessed in Atlas, which enables gestionnaires de donn\u00e9es<\/strong><\/a> to define technical and business metadata.<\/li>\n
  3. Search and lineage:<\/strong> The intuitive UI in Apache Atlas allows predefined and temporary exploration of data types by type, category, attribute value, or free text. In addition, it retains a history of how the data source or explicit data was constructed and how it evolved over time.<\/li>\n
  4. Security and data masking:<\/strong> Apache Atlas is primarily a data governance tool that allows fine-grained security of metadata access to set up access control over entity instances, as well as add\/update\/remove classifications, and so on.<\/li>\n<\/ol>\n

    Best Open Source Data Catalog Tools – 2. Amundsen Lyft<\/h3>\n

    As an open source data catalog platform originally built by Lyft’s engineering team, Amundsen opened source in October 2019, a year after launching for internal use.<\/p>\n

    Amundsen has a cohesive community of contributors and users, and is widely adopted by other organizations built on top of this open source data catalog tool to advance their data democratization, governance, and metadata service initiatives.<\/p>\n

    Main Capabilities of Amundsen:<\/strong><\/p>\n

      \n
    1. Easy to find trusted data:<\/strong> Amundsen helps find data from a variety of sources with simple text searches, and the search results even display online metadata.<\/li>\n
    2. Automated and curated metadata:<\/strong> When a data asset is clicked, the user is shown its detailed description and behavior, which are manually curated and automatically generated, respectively.<\/li>\n
    3. Ability to share context with colleagues:<\/strong> Descriptions of data assets can be updated, reducing the need for colleagues to go back and forth looking for more context for a particular data asset.<\/li>\n
    4. Learn and understand from data usage:<\/strong> Users can see which data assets are frequently used, owned, or bookmarked, and can even see the most common queries related to tables by looking at the dashboards built on a given table.<\/li>\n<\/ol>\n

      Best Open Source Data Catalog Tools – 3. LinkedIn DataHub<\/h3>\n

      As an open source metadata management platform developed by LinkedIn’s engineering team, DataHub is really LinkedIn’s second attempt to address the challenges of data cataloging, discovery, observability and lineage.<\/p>\n

      Prior to DataHub, they built an open source data directory tool called WhereHows back in 2016. DataHub was announced in 2019 and opened source in 2020. As a result, LinkedIn maintains two different versions of DataHub — one for internal use and one open source for others that can be built.<\/p>\n

      Main Capabilities of DataHub:<\/strong><\/p>\n

        \n
      1. Automated metadata ingestion:<\/strong> In LinkedIn DataHub, metadata is ingestion from different sources via API or Kafka stream push.<\/li>\n
      2. Easy data discovery:<\/strong> At the highest level for end users, the DataHub front end supports three types of interaction: search, browse, and view\/edit metadata.<\/li>\n
      3. Understand data through context:<\/strong> Each data entity on DataHub comes with a profile page that displays all metadata associated with that data entity, providing the user with the information needed to develop that data context.<\/li>\n<\/ol>\n

        Best Open Source Data Catalog Tools – 4. Netflix Metacat<\/h3>\n

        As a joint metadata management service built by Netflix and opened source in June 2018, Metacat aims to simplify the sorting, discovery, processing, and management of data.<\/p>\n

        Metacat primarily forms a single source of access to all of Netflix’s data assets. While Metacat is an open source data catalog, there appears to be a lack of significant public knowledge for others to effectively use its schema and extend it.<\/p>\n

        Main Capabilities of Metacat:<\/strong><\/p>\n

          \n
        1. Data abstraction and interoperability:<\/strong> Metacat forms a common abstraction layer, and datasets can be accessed across Netflix’s multiple query engines.<\/li>\n
        2. Business and USER-DEFINED metadata stores:<\/strong> Metacat helps document business and user-defined metadata about data assets, ensures that data users are provided with more information about data assets, and standard rules for how to deal with them.<\/li>\n
        3. Data discovery:<\/strong> Metacat provides schema metadata and business\/user defined metadata for data via ElasticSearch and this helps query through text search.<\/li>\n
        4. Data change audit and notification:<\/strong> Captures any metadata changes or updates, enabling push notifications for such events that might require the user’s attention.<\/li>\n<\/ol>\n

          What are the benefits of open source data catalog tools?<\/h3>\n

          High-quality data catalogs not only allow you to properly categorize all your data, they also allow you to properly track data flows between different data types and even show you flaws in data flows that you can improve.<\/p>\n

          Another nice feature is that sensitive data can also be managed, and the tool can identify where sensitive data is displayed the most, thereby reducing the risk of leakage. Some high-end data catalog tools even offer machine learning capabilities that can understand how you manage your data and help you process large amounts of data. But why use the open source data directory tool?<\/p>\n

          Open source data catalog tools are still high-quality software, inexpensive, sometimes even free, but they scale well, offer a lot of customization options, and can work without any limitations, ideal for high data volumes.<\/p>\n

          Beyond that, as a business or organization, you don’t have to worry about relying on one developer for updates, as you can hire developers to further develop open source software, or easily customize it to suit your needs.<\/p>\n

          Conclusion<\/h3>\n

          Merci d'avoir lu notre article et nous esp\u00e9rons qu'il pourra vous aider \u00e0 trouver le best open source data catalog tools<\/strong> in 2022. If you want to find more information about open source data catalog tools, we would like to advise you to visit Gudu SQLFlow<\/strong><\/a> pour plus d'informations.<\/p>\n

          En tant que l'un des\u00a0meilleurs outils de lignage de donn\u00e9es<\/a><\/strong>\u00a0Disponible sur le march\u00e9 aujourd'hui, Gudu SQLFlow peut non seulement analyser les fichiers de script SQL, mais aussi obtenir\u00a0lign\u00e9e de donn\u00e9es<\/strong><\/a>, et effectuer un affichage visuel, mais permettent \u00e9galement aux utilisateurs de fournir une lign\u00e9e de donn\u00e9es au format CSV et d'effectuer un affichage visuel.\u00a0(Publi\u00e9 par Ryan le 16 juillet 2022)<\/strong><\/p>\n<\/div><\/div><\/div>