{"id":2642,"date":"2022-11-29T13:57:48","date_gmt":"2022-11-29T13:57:48","guid":{"rendered":"https:\/\/swatilathia.com\/?page_id=2642"},"modified":"2023-01-05T03:51:45","modified_gmt":"2023-01-05T03:51:45","slug":"enforcing-data-quality-extending-sql-server-integration-services","status":"publish","type":"page","link":"https:\/\/swatilathia.com\/?page_id=2642","title":{"rendered":"Enforcing Data Quality"},"content":{"rendered":"<body>\n<p class=\"has-medium-font-size\">Here we will see Data Quality Services (DQS) : Data Cleansing &amp; Data Matching<\/p>\n\n\n\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-69e70b96ae952\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-69e70b96ae952\"  aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/swatilathia.com\/?page_id=2642\/#Introduction_to_Data_Quality_Services_DQS\" >Introduction to Data Quality Services (DQS)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/swatilathia.com\/?page_id=2642\/#Problems_with_Inaccurate_Data\" >Problems with Inaccurate Data<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/swatilathia.com\/?page_id=2642\/#DQS_%E2%80%93_The_Best_Solution_for_Busines_Requirements\" >DQS \u2013 The Best Solution for Busines Requirements<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/swatilathia.com\/?page_id=2642\/#Data_Quality_Features\" >Data Quality Features<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Introduction_to_Data_Quality_Services_DQS\"><\/span>Introduction to Data Quality Services (DQS)<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<ul class=\"has-medium-font-size wp-block-list\">\n<li>SQL Server Data Quality Services (DQS) is a knowledge-driven data quality product. Building a knowledge base using DQS gives you the ability to use it for a number of crucial data quality tasks, such as data correction, enrichment, standardization, and de-duplication.<\/li>\n\n\n\n<li>Data Quality Server and Data Quality Client are the two components of DQS, and SQL Server includes both of them by default. Data Quality Server is a SQL Server instance feature comprised of three SQL Server catalogues which provide data-quality functionality and storage.<\/li>\n\n\n\n<li>Data Quality Client is a SQL Server shared feature that allows business users, information workers, and IT professionals to conduct computer-assisted data quality analyses and manage data quality in an interactive manner.<\/li>\n\n\n\n<li>Data Quality Services (DQS) offers a data-quality solution that allows a data steward or IT professional to maintain the integrity of their data and ensure that it is fit for business use.<\/li>\n\n\n\n<li>DQS is a knowledge-driven solution that allows you to manage the integrity and quality of your data sources in both computer-assisted and interactive ways.<\/li>\n\n\n\n<li>DQS allows you to discover, create, and manage knowledge about your data. This knowledge can then be applied to data cleansing, matching, and profiling.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Problems_with_Inaccurate_Data\"><\/span>Problems with Inaccurate Data<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<ul class=\"has-medium-font-size wp-block-list\">\n<li>Inaccurate data can be caused by user input errors, transmission or storage corruption, mismatched data dictionary definitions, and other data quality and process issues. <\/li>\n\n\n\n<li>Aggregating data from different sources that use different data standards, as well as applying an arbitrary rule or overwriting historical data, can result in inconsistent data.<\/li>\n\n\n\n<li>Incorrect data negatively affects a company\u2019s ability to perform business functions and provide services to customers, resulting in a loss of credibility and revenue, customer dissatisfaction, and compliance issues. <\/li>\n\n\n\n<li>Incorrect data frequently causes automated systems to fail, and bad data wastes the time and energy of people performing manual processes. Incorrect data can disrupt data analysis, reporting, data mining, and data warehousing.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"DQS_%E2%80%93_The_Best_Solution_for_Busines_Requirements\"><\/span>DQS \u2013 The Best Solution for Busines Requirements<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<ul class=\"has-medium-font-size wp-block-list\">\n<li>A data quality solution can improve data reliability, accessibility, and re-usability. <\/li>\n\n\n\n<li>It can improve your data\u2019s completeness, accuracy, conformity, and consistency, resolving issues caused by bad data in business intelligence or data warehouse workloads as well as operational OLTP (Online Transaction Processing) systems.<\/li>\n\n\n\n<li>DQS facilitates a non-programmer business user, information worker, or IT professional to create, maintain, and execute their organization\u2019s data quality operations with minimal setup or preparation time.<\/li>\n\n\n\n<li>DQS indicates potentially wrong data and gives you a prediction of how likely is that the data is inaccurate. You can analyze the suitability of the data by using the semantic knowledge of the data that DQS gives you.\u00a0 <\/li>\n\n\n\n<li>DQS provides you to resolve issues involving incompleteness, lack of conformity, inconsistency, inaccuracy, invalidity, and data duplication.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Data_Quality_Features\"><\/span>Data Quality Features<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"has-medium-font-size\">DQS provides the following features to resolve data quality issues.<\/p>\n\n\n\n<p class=\"has-medium-font-size\"><strong>Data cleansing<\/strong> : It is the process of modifying, removing, or enriching incorrect or incomplete data using both computer-assisted and interactive processes.<\/p>\n\n\n\n<p class=\"has-medium-font-size\"><strong>Matching<\/strong> : It is the method of identifying semantic duplicates in a rules-based process that allows you to determine what constitutes a match and removes duplicate data.<\/p>\n\n\n\n<p class=\"has-medium-font-size\"><strong>Profiling <\/strong>: profiling is the study of a data source to give insight into the quality of the data at each level of the knowledge discovery, domain management, matching, and data purification processes<\/p>\n\n\n\n<p class=\"has-medium-font-size\"><strong>Knowledge Base :<\/strong> Data Quality Services is a knowledge-driven solution which analyses data using the knowledge you develop. This makes it possible for you to develop data quality procedures that continuously advance our understanding of your data, thereby enhancing its quality.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img data-recalc-dims=\"1\" decoding=\"async\" width=\"473\" height=\"468\" src=\"https:\/\/i0.wp.com\/swatilathia.com\/wp-content\/uploads\/2023\/01\/image.png?resize=473%2C468&#038;ssl=1\" alt=\"\" class=\"wp-image-2673\" loading=\"lazy\" srcset=\"https:\/\/i0.wp.com\/swatilathia.com\/wp-content\/uploads\/2023\/01\/image.png?w=473&amp;ssl=1 473w, https:\/\/i0.wp.com\/swatilathia.com\/wp-content\/uploads\/2023\/01\/image.png?resize=300%2C297&amp;ssl=1 300w\" sizes=\"auto, (max-width: 473px) 100vw, 473px\" \/><\/figure>\n\n\n\n<p><\/p>\n<\/body>","protected":false},"excerpt":{"rendered":"<p>Here we will see Data Quality Services (DQS) : Data Cleansing &amp; Data Matching Introduction to Data Quality Services (DQS) Problems with Inaccurate Data DQS \u2013 The Best Solution for Busines Requirements Data Quality Features DQS provides the following features to resolve data quality issues. Data cleansing : It is the process of modifying, removing, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"zakra_page_container_layout":"customizer","zakra_page_sidebar_layout":"customizer","zakra_remove_content_margin":false,"zakra_sidebar":"customizer","zakra_transparent_header":"customizer","zakra_logo":0,"zakra_main_header_style":"default","zakra_menu_item_color":"","zakra_menu_item_hover_color":"","zakra_menu_item_active_color":"","zakra_menu_active_style":"","zakra_page_header":true,"om_disable_all_campaigns":false,"footnotes":""},"class_list":["post-2642","page","type-page","status-publish","hentry"],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/pages\/2642","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/swatilathia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2642"}],"version-history":[{"count":3,"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/pages\/2642\/revisions"}],"predecessor-version":[{"id":2674,"href":"https:\/\/swatilathia.com\/index.php?rest_route=\/wp\/v2\/pages\/2642\/revisions\/2674"}],"wp:attachment":[{"href":"https:\/\/swatilathia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2642"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}