{"id":841,"date":"2020-12-30T13:48:47","date_gmt":"2020-12-30T11:48:47","guid":{"rendered":"https:\/\/www.flip-design.de\/?p=841"},"modified":"2021-01-24T18:52:30","modified_gmt":"2021-01-24T16:52:30","slug":"a-first-look-to-azure-purview-and-how-to-connect-local-data-sources","status":"publish","type":"post","link":"https:\/\/www.flip-design.de\/?p=841","title":{"rendered":"A first look to Azure Purview and how to connect local data sources"},"content":{"rendered":"\n

Azure Purview is the next generation of the Azure Data Catalog. Now we have a Public Preview of this service and there are some changes how to catalogue local data sources.
Yesterday I started with Power Bis is a good way to create a catalogue with all data source types. Actually Power BI is a little bit limited, because you only see the dataset on a import mode report without any tables, columns and so on. If you use a direct query dataset, you see the source, but also without tables and columns. Another things was, that you get every workspace and report regardless if it was deleted or active. But we talk about a preview and with the Data Catalog there was no way to get information about Power BI.

Okay, let\u2019s go back to the main topic \u2026 With Purview you can register online and on premises data sources. For the online sources there is no need to install or register additional components. For on premises sources you need to install a self hosted integration runtime<\/a>. It is the runtime which we know from the Data Factory. On the link for the runtime you will get more information about the behavior of this setup.
By registering the Runtime at the Purview portal, you will get the keys and the download link:<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

It is a little bit confusing by the download, because you can download different versions. I used the latest one. After starting the setup and providing the key, the setup finds the runtime which is configured at the portal.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

Actually you can discover SQL Server sources, but no sources of the type of Analysis Services. I think a reason of this behavior is, that the runtime is for the data factory and this will write the sources? I\u2019m now sure, but I think there will come a connector.
Next we need a SQL authenticated login to discover the SQL Server. The user will need high permissions. You can check this on the link above. After that, you need to store the login information of this account in your Azure Key Vault:<\/p>\n\n\n\n

\"\"<\/a>
Is is so great that you can only use credentials from the Key Vault – no paswords stored in the code :)<\/figcaption><\/figure>\n\n\n\n

After that I created on the Purview Page a new data source collection with a data source with the type of SQL  Server.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

For the scheduling you need the Key Vault entry:<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

After a discovery of my source I get all tables of database:<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

It is a little bit confusing that my SQL Server name is MSSQLSERVER. I installed the server as an unnamed instance. This is the reason why. Now you can discover the tables, columns and setup classifications and so on.
I think this tool gives us more flexibility as the Data Catalog. To inventory local data sources and also online sources, it is a little bit different. Hopefully we will get the GA version very soon 😊<\/p>\n","protected":false},"excerpt":{"rendered":"

Azure Purview is the next generation of the Azure Data Catalog. Now we have a Public Preview of this service and there are some changes how to catalogue local data sources.Yesterday I started with Power Bis is a good way … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"categories":[1,30,51],"tags":[],"_links":{"self":[{"href":"https:\/\/www.flip-design.de\/index.php?rest_route=\/wp\/v2\/posts\/841"}],"collection":[{"href":"https:\/\/www.flip-design.de\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.flip-design.de\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.flip-design.de\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.flip-design.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=841"}],"version-history":[{"count":2,"href":"https:\/\/www.flip-design.de\/index.php?rest_route=\/wp\/v2\/posts\/841\/revisions"}],"predecessor-version":[{"id":897,"href":"https:\/\/www.flip-design.de\/index.php?rest_route=\/wp\/v2\/posts\/841\/revisions\/897"}],"wp:attachment":[{"href":"https:\/\/www.flip-design.de\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=841"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.flip-design.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=841"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.flip-design.de\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=841"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}