[ { "url": "https://docs.atlan.com/", "title": "Atlan | Atlan Documentation", "content": "Discover, trust, and govern your data & AI ecosystem Everything you need to get started with Atlan. Set up Snowflake Set up Databricks Set up Power BI Atlan Architecture Browser Extension Get started πŸš€ Quick-start guide Step-by-step onboarding πŸ”§ Secure agent Enterprise-grade deployment options πŸ“ Playbooks automation Rule-based metadata updates at scale Core features πŸ” Find & understand data Search, discover, and profile assets πŸ›‘οΈ Govern & manage Create data contracts & policies πŸ”Œ Integrate Automation, collaboration & other integrations Developer hub βš™οΈ Introductory walkthrough Play with APIs in minutes πŸ’» Client SDKs Java, Python & more πŸ“¦ Packages Developer-built utilities and integrations Atlan University Get started with Atlan by building the right strategy and setting a strong foundation. Atlan Security A comprehensive look at Atlan's security philosophy, core values, and rigorous security procedures Help and support Find answers or contact our team for personalized assistance", "links": [ "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "https://docs.atlan.com/product/capabilities/playbooks", "https://docs.atlan.com/product/capabilities/governance/contracts", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/get-started/what-is-atlan", "https://docs.atlan.com/product/integrations", "https://docs.atlan.com/platform/references/atlan-architecture", "https://docs.atlan.com/get-started/how-tos/quick-start-for-admins", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/set-up-snowflake", "https://docs.atlan.com/secure-agent", "https://docs.atlan.com/product/capabilities/discovery", "https://developer.atlan.com/sdks/", "https://docs.atlan.com/", "https://developer.atlan.com/getting-started/", "https://docs.atlan.com/support/references/customer-support", "https://docs.atlan.com/product/integrations/automation/browser-extension/how-tos/use-the-atlan-browser-extension", "https://docs.atlan.com/apps/connectors/data-warehouses/databricks/how-tos/set-up-databricks" ], "timestamp": 1757443516.3346229, "source": "docs" }, { "url": "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "title": "Set up Microsoft Power BI | Atlan Documentation", "content": "Connect data BI Tools On-premises & Enterprise BI Microsoft Power BI Get Started Set up Microsoft Power BI On this page Set up Microsoft Power BI Who can do this? Depending on the authentication method you choose, you may need a combination of your Cloud Application Administrator or Application Administrator for Microsoft Entra ID, Microsoft 365 administrator for Microsoft 365, and Fabric Administrator ( formerly known as Power BI Administrator ) for Microsoft Power BI to complete these tasks -> you may not have access yourself. This guide outlines how to set up Microsoft Power BI so it can connect with Atlan for metadata extraction and lineage tracking. Before you begin ​ Register application in Microsoft Entra ID ​ Who can do this? You need your Cloud Application Administrator or Application Administrator to complete these stepsβ€”> you may not have access yourself. This is required if the creation of registered applications isn't enabled for the entire organization. To register a new application in Microsoft Entra ID: Log in to the Azure portal . Search for Microsoft Entra ID and select it. Click App registrations from the left . Click + New registration . Enter a name for your client application and click Register . From the Overview screen, copy and securely store: Application (client) ID Directory (tenant) ID Click Certificates & secrets from the left . Under Client secrets , click + New client secret . Enter a description, select an expiry time, and click Add . Copy and securely store the client secret Value . Create security group in Microsoft Entra ID ​ Who can do this? You need your Cloud Application Administrator or Application Administrator to complete these steps - you may not have access yourself. To create a security group for your application: Log in to the Azure portal . Search for Microsoft Entra ID and select it. Click Groups under the Manage section. Click New group . Set the Group type to Security . Enter a Group name and optional description. Click No members selected . Add the appropriate member: For Delegated User authentication : search for the user and select it. For Service Principal authentication : search for the application registration created earlier and select it. Click Select and then Create . By the end of these steps, you have registered an application with Microsoft Entra ID and created a Security Group with the appropriate member. Configure authentication options ​ Atlan supports two authentication methods for fetching metadata from Microsoft Power BI: Service principal authentication (recommended) ​ When using Service Principal authentication, you must decide how the connector shall access metadata to catalog assets and build lineage. There are two supported options: Admin API only ​ This option grants permissions that let the service principal to access only admin-level Power BI APIs. In this mode, Atlan extracts metadata exclusively using administrative endpoints. This option is recommended for stricter access control environments. Who can do this? You need your Fabric Administrator ( formerly known as Power BI Administrator ) to complete these tasks - you may not have access yourself. To configure admin API access: Log in to the Power BI admin portal . Click Tenant settings under Admin portal. Under Admin API settings : Expand Enable service principals to use read-only Power BI admin APIs and set to Enabled Add your security group under Specific security groups Click Apply Expand Enhance admin APIs responses with detailed metadata and set to Enabled Add your security group Click Apply Expand Enhance admin APIs responses with DAX and mashup expressions and set to Enabled Add your security group Click Apply Admin and non-admin APIs ​ This option grants permissions that let the service principal to access both admin and non-admin Power BI APIs. This enables Atlan to extract richer metadata and build detailed lineage across Power BI assets. Assign security group to Power BI workspaces in PowerBI service portal ​ Who can do this? You need to be at least a member of the Microsoft Power BI workspace to which you want to add the security group to complete these steps - you may not have access yourself. Make sure that you add the security group from the page and not the admin portal. To assign a Microsoft Power BI workspace role to the security group: Open the Microsoft Power BI page . Open Workspaces and select the workspace you want to access from Atlan. Click Access . In the panel: Enter the name of your security group where it says Enter email addresses Choose one of the following roles: Viewer : For workspaces without parameters Contributor : For workspaces with semantic models containing parameters or to generate lineage for measures Member : To generate lineage for dataflows Click Add . Configure admin and non-admin API access in PowerBI Service Portal ​ Who can do this? You need your Fabric Administrator ( formerly known as Power BI Administrator ) to complete these tasks - you may not have access yourself. To enable both admin and non-admin API access: Log in to the Power BI admin portal . Click Tenant settings under Admin portal. Under Developer settings : Expand Service principals can use Fabric APIs and set to Enabled Add your security group under Specific security groups Click Apply Under Admin API settings : Expand Enable service principals to use read-only Power BI admin APIs and set to Enabled Add your security group Click Apply Expand Enhance admin APIs responses with detailed metadata and set to Enabled Add your security group Click Apply Expand Enhance admin APIs responses with DAX and mashup expressions and set to Enabled Add your security group Click Apply After making these changes, you typically need to wait 15-30 minutes for the settings to take effect across Microsoft's services. Delegated user authentication ​ info Atlan doesn't recommend using delegated user authentication as it's also not recommended by Microsoft. Fabric administrator role assignment ​ Who can do this? You need your Microsoft 365 administrator to complete these steps - you may not have access yourself. To assign the delegated user to the Fabric Administrator role: Open the Microsoft 365 admin portal . Click Users and then Active users from the left . Select the delegated user. Under Roles , click Manage roles . Expand Show all by category . Under Collaboration , select Fabric Administrator . Click Save changes . API permissions ​ Who can do this? You need your Cloud Application Administrator or Application Administrator to complete these steps, you may not have access yourself. danger The following permissions are only required for delegated user authentication. If using service principal authentication, you don't need to configure any delegated permissions for a service principalβ€”it's recommended that you avoid adding these permissions. These are never used and can cause errors that may be hard to troubleshoot. To add permissions for the registered application : In your app registration, click API permissions under the Manage section. Click Add a permission . Search for and select Power BI Service . Click Delegated permissions and select: Capacity.Read.All Dataflow.Read.All Dataset.Read.All Report.Read.All Tenant.Read.All Workspace.Read.All Click Grant Admin consent (If you only see the Add permissions button, you aren't an administrator). Admin API settings configuration ​ Who can do this? You need your Fabric Administrator ( formerly known as Power BI Administrator ) to complete these tasks, you may not have access yourself. To enable the Microsoft Power BI admin API: Log in to the Power BI admin portal . Click Tenant settings under Admin portal. Under Admin API settings : Expand Enhance admin APIs responses with detailed metadata and set to Enabled Add your security group Click Apply Expand Enhance admin APIs responses with DAX and mashup expressions and set to Enabled Add your security group Click Apply . Tags: data authentication Previous Microsoft Power BI Next Crawl Microsoft Power BI Before you begin Configure authentication options", "links": [ "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/faq/power-bi-dataflow-datasource", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/troubleshooting/troubleshooting-microsoft-power-bi-connectivity", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-does-atlan-crawl-from-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/crawl-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi", "https://docs.atlan.com/", "https://docs.atlan.com/tags/authentication", "https://docs.atlan.com/tags/data", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443517.697475, "source": "docs" }, { "url": "https://docs.atlan.com/product/capabilities/playbooks", "title": "Playbooks | Atlan Documentation", "content": "Configure Atlan Playbooks On this page Playbooks Overview: Atlan's playbooks provide reusable workflows and automation for common data tasks. Create, share, and execute standardized processes to maintain consistency, reduce manual effort, and enable self-service for data consumers while following governance standards. Get started ​ How to set up playbooks Guides ​ Playbook management ​ How to manage playbooks : Monitor and maintain your playbook workflows. How to automate data profiling : Set up automated data quality checks. Troubleshooting ​ Troubleshooting playbooks : Solutions for common playbook issues. Tags: playbooks automation workflows metadata capabilities Next Set up playbooks Get started Guides Troubleshooting", "links": [ "https://docs.atlan.com/product/capabilities/playbooks/troubleshooting/troubleshooting-playbooks", "https://docs.atlan.com/product/capabilities/playbooks", "https://docs.atlan.com/product/capabilities/playbooks/how-tos/set-up-playbooks", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/product/capabilities/playbooks/how-tos/automate-data-profiling", "https://docs.atlan.com/tags/metadata", "https://docs.atlan.com/tags/automation", "https://docs.atlan.com/product/capabilities/playbooks/how-tos/manage-playbooks", "https://docs.atlan.com/", "https://docs.atlan.com/tags/capabilities", "https://docs.atlan.com/tags/playbooks", "https://docs.atlan.com/tags/workflows", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443518.817586, "source": "docs" }, { "url": "https://docs.atlan.com/product/capabilities/governance/contracts", "title": "Contracts | Atlan Documentation", "content": "Build governance Contracts On this page Contracts Overview: Manage data contracts and agreements in Atlan to ensure data quality and compliance. Define and track data quality expectations, service level agreements (SLAs), and data sharing agreements between teams and systems. Get started ​ Follow these steps to implement contracts in Atlan: Create data contracts Guides ​ Add contract impact analysis in GitHub : Detailed instructions on adding contracts for impact analysis in GitHub. Tags: contracts agreements data quality governance atlan Next Create data contracts Get started Guides", "links": [ "https://docs.atlan.com/tags/agreements", "https://docs.atlan.com/product/capabilities/governance/contracts/how-tos/add-contract-impact-analysis-in-github", "https://docs.atlan.com/product/capabilities/governance/contracts", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/product/capabilities/governance/contracts/how-tos/create-data-contracts", "https://docs.atlan.com/tags/governance", "https://docs.atlan.com/tags/atlan", "https://docs.atlan.com/", "https://docs.atlan.com/tags/data-quality", "https://docs.atlan.com/tags/contracts", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443519.873495, "source": "docs" }, { "url": "https://docs.atlan.com/support/submit-request", "title": "Submit support request | Atlan Documentation", "content": "Submit request Aim to include as much information and detail in your request as possible to reduce delays between replies. Name * Email * Subject * Atlan URL * The URL of your Atlan tenant Severity SEV0 (S0) - System down or critical issue SEV1 (S1) - Major functionality affected SEV2 (S2) - General question or minor issue SEV3 (S3) - Feature request or enhancement Refer to severity and response SLA guidelines as outlined here How is this impacting you? I'm unable to use the product A major feature stopped working An issue is slowing me down I have a non-urgent question I have a suggestion that will help me with my use-case I need help with something Description * Attachments πŸ“ Add file or drop files here Submit", "links": [ "https://docs.atlan.com/", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443521.106903, "source": "docs" }, { "url": "https://docs.atlan.com/get-started/what-is-atlan", "title": "What is Atlan? | Atlan Documentation", "content": "Get Started What is Atlan? On this page What is Atlan? We are a modern data workspace that makes collaboration among diverse users like business, analysts, and engineers easier, increasing efficiency and agility in data projects. We started out as a data team, solving social good problems using data science. We built Atlan for ourselves over the course of 200 data projects, which included India's national data platform used by the prime minister and monitoring the Sustainable Development Goals with the United Nations. Atlan helped us build India's national data platform with an 8-member team, making it the fastest project of its kind to go live in just 12 months - instead of the projected three years. Why we built Atlan ​ Data teams can be diverse: analysts, scientists, engineers, and business users. Diverse people with diverse tools and skillsets mean diverse DNAs. All of it led to chaos, which made our Slack channels look like this... We call this \"collaboration overheard\" ​ We knew we couldn't scale like this, there had to be a better way. We borrowed the principles of Agile from product teams, DevOps from engineering teams, and Lean Manufacturing from supply chain teams. We then experimented for two years and across 200 data projects to create our own idea of what makes data teams successful. We call this DataOps . How Atlan helps data teams ​ With Atlan, analyst teams at Unilever have shipped 100+ additional data projects per quarter, while data science teams at Samsung have saved 50% of their time. Create self-service ecosystems by reducing dependencies ​ Atlan makes all your data assets easily discoverable. No more Slack messages like \"Where's that dataset?\" or long email threads for approvals. With Atlan, you can simply Cmd+K your way to the right data asset. Key capabilities : discovery and search , Visual Query Builder , saved queries , READMEs Improve the agility of your data team ​ Data practitioners spend 30-50% of their time finding and understanding data. Atlan cuts that time by 95%. Your data team will be shipping 2-3 times more projects in no time. Key capabilities : visibility of data quality tests and observability alerts, automated lineage , Atlan AI Promote governance and a sustainable data culture ​ Don't lose sleep trying to figure out if your sensitive data is secure. Build ecosystems of trust, make your team happy, and let Atlan manage governance and security behind the scenes. Key capabilities : tag sensitive data , granular access control , data products Tags: atlan documentation Next Administrators Why we built Atlan How Atlan helps data teams", "links": [ "https://docs.atlan.com/product/capabilities/lineage/concepts/what-is-lineage", "https://docs.atlan.com/apps/connectors/observability/monte-carlo/how-tos/set-up-monte-carlo", "https://docs.atlan.com/platform/references/cloud-logging-and-monitoring", "https://docs.atlan.com/product/capabilities/discovery/how-tos/search-and-discover-assets", "https://docs.atlan.com/product/capabilities/atlan-ai/concepts/what-is-atlan-ai", "https://docs.atlan.com/get-started/what-is-atlan", "https://docs.atlan.com/get-started/references/the-dataops-culture-code", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/product/capabilities/data-products/concepts/what-are-data-products", "https://docs.atlan.com/platform/references/atlan-architecture", "https://docs.atlan.com/", "https://docs.atlan.com/platform/concepts/authentication-and-authorization", "https://docs.atlan.com/product/capabilities/insights/how-tos/save-and-share-queries", "https://docs.atlan.com/product/capabilities/governance/tags/how-tos/attach-a-tag", "https://docs.atlan.com/product/integrations", "https://docs.atlan.com/get-started/how-tos/quick-start-for-admins", "https://docs.atlan.com/faq/getting-started-and-onboarding", "https://docs.atlan.com/platform/references/infrastructure-security", "https://docs.atlan.com/tags/atlan", "https://docs.atlan.com/tags/documentation", "https://docs.atlan.com/product/capabilities/governance/custom-metadata/how-tos/control-access-metadata-data" ], "timestamp": 1757443522.24644, "source": "docs" }, { "url": "https://docs.atlan.com/product/integrations", "title": "Integrations | Atlan Documentation", "content": "Configure Atlan Integrations Integrations Atlan integrates with a wide range of tools to help you automate workflows, connect with your favorite apps, and manage identity and access. These integrations connect your data catalog with the tools your teams already use, creating a seamless data experience across your tech stack. Key concepts ​ Integration categories : Atlan offers integrations across five categories: project management, communication, collaboration, automation, and identity management. Connection methods : Most integrations use secure authentication methods like OAuth, API keys, or service accounts. Bi-directional sync : Updates flow between Atlan and integrated tools, ensuring data consistency across platforms. Custom webhooks : Extend Atlan's capabilities by building custom integrations using the provided APIs and webhooks. Core offerings ​ βš™οΈ Automation Connect with platforms like AWS Lambda to automate data workflows and streamline routine tasks. πŸ‘₯ Collaboration Integrate with tools like Slack and Microsoft Teams to enhance team collaboration and knowledge sharing. πŸ’¬ Communication Connect with SMTP for real-time alerts. πŸ” Identity management Integrate with identity providers like Okta and Azure AD for seamless authentication and user management. πŸ“‹ Project management Connect with tools like Jira and Service Now to link data assets to projects and track data-related tasks. Get started ​ 1 Select an integration Choose from Atlan's available integrations based on your team's tools and workflows. β†’ 2 Configure connection Follow the integration-specific setup guide to establish a secure connection with your tool. β†’ 3 Test and activate Verify the integration is working correctly with a test action, then activate for your organization. πŸ’‘ Need a custom integration? Atlan provides APIs and webhooks that let you build custom integrations with any tool in your tech stack. Tags: integrations atlan setup Next Automation Integrations", "links": [ "https://docs.atlan.com/product/integrations/identity-management", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/product/integrations", "https://docs.atlan.com/product/integrations/collaboration", "https://docs.atlan.com/tags/integrations", "https://docs.atlan.com/product/integrations/automation", "https://docs.atlan.com/tags/setup", "https://docs.atlan.com/product/integrations/communication", "https://docs.atlan.com/tags/atlan", "https://docs.atlan.com/", "https://docs.atlan.com/product/integrations/project-management", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443523.304099, "source": "docs" }, { "url": "https://docs.atlan.com/platform/references/atlan-architecture", "title": "Atlan architecture | Atlan Documentation", "content": "Get Started References Atlan architecture On this page Atlan architecture Atlan is a cloud-first solution. Single-tenant SaaS is the recommended deployment model. Atlan currently supports hosting tenants on the following cloud platforms: Amazon Web Services (AWS) ​ Microsoft Azure ​ Google Cloud Platform (GCP) ​ The components of Atlan are isolated, across both compute and data. For more details, see How are resources isolated? Platform components ​ Kong is an API gateway. It handles rate limiting and token verification on all incoming API requests. Apache Keycloak is an identity and access management component. It manages everything to do with users, login, SSO and so on. Heracles is Atlan's API service. It houses the business logic used by the frontend and APIs to interact with other platform components. PostgreSQL is a SQL database. Many services on the platform use it for storage. HashiCorp Vault is a secret manager. It stores sensitive credentials provided by the user. Apache Ranger is the policy engine. It provides fine-grained access control over data in the metastore. Argo Workflows is a workflow orchestrator for k8s. It runs and manages long-running jobs in a container and k8s-native fashion. Admission Controller is a k8s admission controller. It performs certain actions when Argo Workflows are updated such as workflow alerts. Metastore stores metadata as data in a graph store. It is based on Apache Atlas and has fine-grained access control on top. Apache Zookeeper manages consensus and coordination for the metastore services. Elasticsearch indexes data and drives search functionality. Apache Cassandra is an object-oriented database used to store the metastore's data. Apache Kafka is an event stream. It enables event-driven use cases across the platform. Heka is Atlan's SQL component. It parses, rewrites and optimizes SQL queries and is powered by Apache Calcite . Redis is a cache layer used by Heracles. Platform management components ​ Velero performs cluster backups. Kibana explores and filters log data stored in Elasticsearch. Fluent Bit is a logging and metrics processor. It parses and pushes logs from pods to various destinations. Elasticsearch stores and indexes logs. Central components ​ Zenduty is used for incident response. Alerts are sent when something goes wrong in one of the clusters. Argo CD is used for continuous deployment. Changes in git repositories lead to upgrades in the clusters. Github Actions update the Docker container images as part of the development process. Sendgrid is used to send emails. The frontend is a Vue.js web application that's hosted on S3 and delivered via Amazon CloudFront content delivery network (CDN) service. Alertmanager sends alerts generated by metrics stored in Prometheus. Grafana provides observability dashboards. VictoriaMetrics is a fast, cost-effective, and scalable monitoring solution and time series database. It processes high volumes of data and enables long-term storing. Atlan marketplace (not pictured) ​ The marketplace offers packages (workflows) that perform long-running tasks on the Atlan platform. The ecosystem enables the creation of metadata and lineage connectors. See security.atlan.com for the latest policies and standards, reports and certifications, architecture, diagrams and more. Tags: security access-control permissions Previous Incident response plan Next Product release stages Platform components Platform management components Central components Atlan marketplace (not pictured)", "links": [ "https://docs.atlan.com/platform/references/how-are-resources-isolated", "https://docs.atlan.com/tags/access-control", "https://docs.atlan.com/platform/references/quality-assurance-framework", "https://docs.atlan.com/platform/references/cloud-logging-and-monitoring", "https://docs.atlan.com/get-started/what-is-atlan", "https://docs.atlan.com/get-started/references/the-dataops-culture-code", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/platform/references/atlan-architecture", "https://docs.atlan.com/platform/references/incident-response-plan", "https://docs.atlan.com/", "https://docs.atlan.com/platform/concepts/authentication-and-authorization", "https://docs.atlan.com/tags/security", "https://docs.atlan.com/get-started/how-tos/quick-start-for-admins", "https://docs.atlan.com/faq/getting-started-and-onboarding", "https://docs.atlan.com/tags/permissions", "https://docs.atlan.com/get-started/references/our-3-pro-tips-for-saving-time-with-atlan", "https://docs.atlan.com/platform/references/infrastructure-security", "https://docs.atlan.com/get-started/faqs/how-are-product-updates-deployed", "https://docs.atlan.com/get-started/references/product-release-stages" ], "timestamp": 1757443524.389663, "source": "docs" }, { "url": "https://docs.atlan.com/get-started/how-tos/quick-start-for-admins", "title": "Administrators | Atlan Documentation", "content": "Get Started Quick Start Guides Administrators On this page Administrators User management ​ User management is a critical part of data governance. Atlan's user management capabilities should be a mainstay of how you organize and control access for people in your organization. Add and manage users from the admin center ​ It's super simple to invite and remove users from Atlan from the Admin center . You can also manage existing users by adding them to groups, changing their roles, or set up SSO , SCIM , and SMTP configurations. Manage access control from the governance center ​ The Governance center is where you can build access control mechanisms to manage user access . Personas allow you to group users into teams, such as Financial Analysts or Cloud Engineers , and set policies based on the access those personas should have. Purposes are where you can build policies based on the actions or access that a user might need. For example, you can use Atlan's policy-based access controls to manage access to PII and other sensitive data. This is a best practice for data governance. Once you set these policies, Atlan will enforce them throughout your users' experience. This means that users who don't have access to a particular type of data will not be able to see it. Governance workflows help you set up robust controls on data access management, metadata enrichment, new entity creation, and more, with out-of-the-box workflow templates and automated execution. Asset profile ​ The asset profile in Atlan gives you a quick and clear understanding of what a data asset contains. You can think of the asset profile as the TL;DR about your data. Glossary ​ The Atlan glossary is a rich tool for defining and organizing your data terminology to improve transparency and share knowledge. No need to ask around for what a column name means. The glossary functions as a source of truth for teams to understand their data assets. Start keeping all your definitions in one searchable place. The glossary provides key intel on your data assets so you can quickly understand important attributes of your data, such as: Owners of your data, so you know who to ask for clarification. Certificate status, to easily understand if metadata enrichment is still in progress or the asset is ready to be used. Linked assets that are relevant to the term, so you can explore other helpful material. Did you know? The glossary helps power Atlan's powerful search tool , so tagging and defining assets are critical to helping your team find what they need. Discovery ​ We rely on search bars to find things in almost every corner of the internet. Atlan uses a similar search tool to help you explore your data assets. The discovery tool is Atlan's powerful in-platform search, powered by the terms and descriptions you've added to your data assets. Here are a few of the things that make Atlan's discovery awesome: Every attribute of your data is searchable in Atlan - saved SQL queries, schemas, links, and more. This lets you search far and wide to find exactly what you need. Intelligent keyword recognition sees through your typos to show exactly what you wanted, no matter what you actually typed. Search assets from just about any page in Atlan using Cmd/Ctrl+K or by clicking Search assets across Atlan at the top of any page. Control your search by using facets about your data (such as the verification status or owner) to find what's most important to you. Sort by popularity to quickly discover what assets your teammates are using every day. Tags: get-started quick-start Previous What is Atlan? Next Data consumers User management Asset profile Glossary Discovery", "links": [ "https://docs.atlan.com/product/capabilities/governance/glossary/how-tos/link-terms-to-assets", "https://docs.atlan.com/product/capabilities/governance/glossary/concepts/what-is-a-glossary", "https://docs.atlan.com/product/integrations/communication/smtp-and-announcements/how-tos/configure-smtp", "https://docs.atlan.com/platform/references/cloud-logging-and-monitoring", "https://docs.atlan.com/product/capabilities/discovery/how-tos/add-owners", "https://docs.atlan.com/product/capabilities/discovery/how-tos/search-and-discover-assets", "https://docs.atlan.com/get-started/what-is-atlan", "https://docs.atlan.com/tags/get-started", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/product/integrations/identity-management/sso", "https://docs.atlan.com/platform/references/atlan-architecture", "https://docs.atlan.com/product/capabilities/governance/access-control/concepts/what-are-personas", "https://docs.atlan.com/product/integrations/identity-management/scim/how-tos/configure-scim-provisioning", "https://docs.atlan.com/product/capabilities/discovery/concepts/what-are-asset-profiles", "https://docs.atlan.com/", "https://docs.atlan.com/platform/concepts/authentication-and-authorization", "https://docs.atlan.com/product/capabilities/discovery/how-tos/add-certificates", "https://docs.atlan.com/product/capabilities/governance/stewardship/how-tos/automate-data-governance", "https://docs.atlan.com/get-started/how-tos/quick-start-for-contributors", "https://docs.atlan.com/tags/quick-start", "https://docs.atlan.com/get-started/how-tos/quick-start-for-admins", "https://docs.atlan.com/faq/getting-started-and-onboarding", "https://docs.atlan.com/product/capabilities/governance/users-and-groups/how-tos/invite-new-users", "https://docs.atlan.com/product/capabilities/governance/access-control/concepts/what-are-purposes", "https://docs.atlan.com/product/capabilities/governance/users-and-groups/how-tos/manage-users", "https://docs.atlan.com/platform/references/infrastructure-security", "https://docs.atlan.com/get-started/how-tos/quick-start-for-data-consumers", "https://docs.atlan.com/product/capabilities/governance/custom-metadata/how-tos/control-access-metadata-data", "https://docs.atlan.com/get-started/references/api-authentication" ], "timestamp": 1757443525.5287402, "source": "docs" }, { "url": "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/set-up-snowflake", "title": "Set up Snowflake | Atlan Documentation", "content": "Connect data Data Warehouses Snowflake Get Started Set up Snowflake On this page Set up Snowflake Who can do this? You need your Snowflake administrator to run these commands - you may not have access yourself. Create user and role in Snowflake ​ Create a role and user in Snowflake using the following commands: Create role ​ Create a role in Snowflake using the following commands: CREATE OR REPLACE ROLE atlan_user_role ; GRANT OPERATE , USAGE ON WAREHOUSE \"\" TO ROLE atlan_user_role ; Replace with the default warehouse to use when running the Snowflake crawler . Atlan requires the following privileges to: OPERATE enables Atlan to start the virtual warehouse to fetch metadata if the warehouse has stopped. USAGE enables Atlan to show or list metadata from Snowflake. This in turn enables the Snowflake crawler to run the SHOW query. Create a user ​ Create a separate user to integrate into Atlan, using one of the following 3 options: With a public key in Snowflake ​ See Snowflake's official guide for details on generating an RSA key-pair . To create a user with a key-pair, replace the value for rsa_public_key with the public key and run the following: CREATE USER atlan_user rsa_public_key = 'MIIBIjANBgkqh...' default_role = atlan_user_role default_warehouse = '' display_name = 'Atlan' TYPE = 'SERVICE' Learn more about the SERVICE type property in Snowflake documentation . Did you know? Atlan only supports encrypted private keys with a non-empty passphrase - generally recommended as more secure. An empty passphrase results in workflow failures. To generate an encrypted private key, omit the -nocrypt option. Refer to Snowflake documentation to learn more. With a password in Snowflake ​ Did you know? Snowflake recommends transitioning away from basic authentication using username and password. Change to key-pair authentication for enhanced security. For any existing Snowflake workflows, you can modify the crawler configuration to update the authentication method. To create a user with a password, replace and run the following: CREATE USER atlan_user password = '' default_role = atlan_user_role default_warehouse = '' display_name = 'Atlan' TYPE = 'LEGACY_SERVICE' Learn more about the LEGACY_SERVICE type property in Snowflake documentation . Managed through your identity provider (IdP) Private preview ​ This method is currently only available if Okta is your IdP (Snowflake supports) authenticating natively through Okta : Create a user in your identity provider (IdP) and use federated authentication in Snowflake . The password for this user must be maintained solely in the IdP and multi-factor authentication (MFA) must be disabled. Grant role to user ​ To grant the atlan_user_role to the new user: GRANT ROLE atlan_user_role TO USER atlan_user ; Configure OAuth (client credentials flow) with Microsoft Entra ID ​ To configure OAuth authentication using Microsoft Entra ID (formerly Azure AD) with the client credentials flow: Follow Snowflake's documentation to: Register a new application in Microsoft Entra ID Collect the client ID , tenant ID , and client secret Add the required API permissions In Snowflake, create a security integration using the following: CREATE SECURITY INTEGRATION external_oauth_azure_ad TYPE = external_oauth ENABLED = true EXTERNAL_OAUTH_TYPE = azure EXTERNAL_OAUTH_ISSUER = '\\' EXTERNAL_OAUTH_JWS_KEYS_URL = '\\' EXTERNAL_OAUTH_AUDIENCE_LIST = ( '\\' ) EXTERNAL_OAUTH_TOKEN_USER_MAPPING_CLAIM = 'sub' EXTERNAL_OAUTH_SNOWFLAKE_USER_MAPPING_ATTRIBUTE = 'login_name' ; Replace the placeholders with actual values from your Azure AD app: β†’ Your tenant's OAuth 2.0 issuer URL β†’ Azure JWKs URI β†’ Application ID URI of the Azure app Create a Snowflake user with a login name that exactly matches the Azure AD client object ID: CREATE USER oauth_svc_user WITH LOGIN_NAME = '\\' -- Use Azure client OBJECT ID DEFAULT_ROLE = \\ < ROLE\\ > DEFAULT_WAREHOUSE = \\ < WAREHOUSE\\ > ; Grant the configured role to this user: GRANT ROLE \\ < ROLE\\ > TO USER oauth_svc_user ; Choose metadata fetching method ​ Atlan supports two methods for fetching metadata from Snowflake - account usage and information schema. You should choose one of these two methods to set up Snowflake: Account usage Information schema Overview Simplified grants but some limitations in functionality Most comprehensive approach, more grant management required Method Views in the SNOWFLAKE database that display object metadata and usage metrics for your account System-defined views and table functions that provide extensive metadata for objects created in your account Permissions User role and account, single grant for SNOWFLAKE database User role and account, multiple grants per database Data latency 45 minutes to 3 hours (varies by view) None Historical data retention 1 year 7 days to 6 months (varies by view or table function) Asset extraction ACCOUNT_USAGE schema INFORMATION_SCHEMA schema View lineage ACCOUNT_USAGE schema INFORMATION_SCHEMA schema Table lineage ACCOUNT_USAGE schema ACCOUNT_USAGE schema Tag import ACCOUNT_USAGE schema ACCOUNT_USAGE schema Usage and popularity ACCOUNT_USAGE schema ACCOUNT_USAGE schema Metadata extraction time Varies by warehouse size. For example, 8 minutes for 10 million assets (recommended for extracting a large number of assets) Varies by warehouse size. For example, 2+ hours for 10 million assets Extraction limitations External table location data, procedures, and primary and foreign keys None Grant permissions for account usage method ​ danger If you want to set warehouse timeouts when using this method, set a large value initially for the workflow to succeed. Once the workflow has succeeded, adjust the value to be twice the extraction time. This method uses the views in SNOWFLAKE.ACCOUNT_USAGE (or a copied version of this schema) to fetch the metadata from Snowflake into Atlan. You can be more granular with permissions using this method, but there are limitations with this approach . To crawl assets, generate lineage, and import tags ​ If you also want to be able to preview and query the data, you can use the preview and query existing assets permissions instead. Snowflake stores all tag objects in the ACCOUNT_USAGE schema. If you're using the account usage method to crawl metadata in Atlan or you have configured the Snowflake miner , you need to grant the same permissions to import tags as required for crawling Snowflake assets. Note that object tagging in Snowflake currently requires Enterprise Edition or higher . To use the default SNOWFLAKE database and ACCOUNT_USAGE schema and also mine Snowflake's query history (for lineage), grant these permissions: USE ROLE ACCOUNTADMIN ; GRANT IMPORTED PRIVILEGES ON DATABASE SNOWFLAKE TO ROLE atlan_user_role ; The ACCOUNTADMIN role is required to grant privileges on the SNOWFLAKE database due to the following reasons: By default, only the ACCOUNTADMIN role can access the SNOWFLAKE database. To enable other roles to access the database and schemas and query the views, a user with the ACCOUNTADMIN role needs to grant IMPORTED PRIVILEGES on the SNOWFLAKE database to the desired roles. To use a copied or cloned version of this default schema, where you can also remove any sensitive data for security purposes, grant these permissions: GRANT USAGE ON DATABASE \"\" TO ROLE atlan_user_role ; GRANT USAGE ON SCHEMA \"\" IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON ALL VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; Replace with the copied Snowflake database name. Replace with the copied Snowflake ACCOUNT_USAGE schema name. The grants for the copied version can't be used on the original SNOWFLAKE database. This is because Snowflake produces an error that granular grants can't be given to imported databases. When using a cloned or copied version, verify that the table or view definition remains unchanged as in your SNOWFLAKE database. If the format is different. For example, a column is missing and it no longer qualifies as a clone. To crawl streams ​ To crawl streams, provide the following permissions: To crawl current streams: GRANT USAGE ON ALL SCHEMAS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON ALL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL STREAMS IN DATABASE \"\" TO ROLE atlan_user_role ; Replace with the Snowflake database name. To crawl future streams: GRANT USAGE ON FUTURE SCHEMAS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON FUTURE TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE STREAMS IN DATABASE \"\" TO ROLE atlan_user_role ; Replace with the Snowflake database name. (Optional) To preview and query existing assets ​ To query and preview data within assets that already exist in Snowflake, add these permissions: GRANT USAGE ON DATABASE \"\" TO ROLE atlan_user_role ; GRANT USAGE ON ALL SCHEMAS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL EXTERNAL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL MATERIALIZED VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL STREAMS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT MONITOR ON PIPE \"\" TO ROLE atlan_user_role ; Replace with the database you want to be able to preview and query in Atlan. (Repeat the statements for every database you wish to preview and query in Atlan.) (Optional) To preview and query future assets ​ To query and preview data within assets that may be created in the future in Snowflake, add these permissions. Again, if you want to also be able to preview and query the data for future assets, you can add the preview and query future assets permissions instead. GRANT USAGE ON FUTURE SCHEMAS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE EXTERNAL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE MATERIALIZED VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE STREAMS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT MONITOR ON FUTURE PIPES IN DATABASE \"\" TO ROLE atlan_user_role ; Replace with the database you want to be able to preview and query in Atlan. (Repeat the statements for every database you want to preview and query in Atlan.) danger Verify that all the assets you'd like to crawl are present in these grants by checking the grants on the user role defined for the crawler. Grant permissions for information schema method ​ This method uses views in the INFORMATION_SCHEMA schema in Snowflake databases to fetch metadata. You still need to grant specific permissions to enable Atlan to crawl metadata, preview data, and query data with this method. To crawl existing assets ​ Grant these permissions to crawl assets that already exist in Snowflake. If you also want to be able to preview and query the data, you can use the preview and query existing assets permissions instead. Grant permissions to crawl existing assets: GRANT USAGE ON DATABASE \"\" TO ROLE atlan_user_role ; GRANT USAGE ON ALL SCHEMAS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON ALL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON ALL EXTERNAL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON ALL VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON ALL MATERIALIZED VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL STREAMS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT MONITOR ON PIPE \"\" TO ROLE atlan_user_role ; Replace with the database you want to be available in Atlan. (Repeat the statements for every database you wish to integrate into Atlan.) Grant permissions to crawl functions: GRANT USAGE ON ALL FUNCTIONS IN DATABASE \"\" TO ROLE atlan_user_role ; Replace with the database you want to be available in Atlan. (Repeat the statements for every database you wish to integrate into Atlan.) For secure user-defined functions (UDFs), grant OWNERSHIP permissions to retrieve metadata: GRANT OWNERSHIP ON FUNCTION < schema_name > . < udf_name > TO ROLE < role_name > ; Replace the placeholders with the appropriate values: : The name of the schema that contains the user-defined function (UDF). : The name of the secure UDF that requires ownership permissions. : The role that gets assigned ownership of the secure UDF. Did you know? The statements given on this page apply to all schemas, tables, and views in a database in Snowflake. If you want to limit access to only certain objects, you can instead specify the exact objects individually as well. To crawl future assets ​ To crawl assets that may be created in the future in Snowflake, add these permissions. Again, if you want to also be able to preview and query the data for future assets, you can add the preview and query future assets permissions instead. To grant permissions at a database level: GRANT USAGE ON FUTURE SCHEMAS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON FUTURE TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON FUTURE EXTERNAL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON FUTURE VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON FUTURE MATERIALIZED VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE STREAMS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT MONITOR ON FUTURE PIPES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT USAGE ON FUTURE FUNCTIONS IN DATABASE \"\" TO ROLE atlan_user_role ; Replace with the database you want to crawl in Atlan. (Repeat the statements for every database you want to integrate into Atlan.) danger For any future grants defined at a schema level to a different role, the schema-level grants take precedence over the database-level grants and any future grants defined at a database level to the Atlan role get ignored. To learn more, refer to Snowflake documentation . To grant permissions at a schema level: GRANT REFERENCES ON FUTURE TABLES IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT REFERENCES ON FUTURE EXTERNAL TABLES IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT REFERENCES ON FUTURE VIEWS IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT REFERENCES ON FUTURE MATERIALIZED VIEWS IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE STREAMS IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT MONITOR ON FUTURE PIPES IN SCHEMA \".\" TO ROLE atlan_user_role ; Replace with the database and with the schema you want to crawl in Atlan. (Repeat the statements for every database and schema you want to integrate into Atlan.) To mine query history for lineage ​ To also mine Snowflake's query history (for lineage), add these permissions. You can use either option: To mine query history direct from Snowflake's internal tables: USE ROLE ACCOUNTADMIN ; GRANT IMPORTED PRIVILEGES ON DATABASE snowflake TO ROLE atlan_user_role ; To mine query history from a cloned or copied set of tables, where you can also remove any sensitive data: GRANT USAGE ON DATABASE \"\" TO ROLE atlan_user_role ; GRANT USAGE ON SCHEMA \"\" . \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL TABLES IN SCHEMA \"\" . \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL VIEWS IN SCHEMA \"\" . \"\" TO ROLE atlan_user_role ; Replace with the name of the cloned database, and with the name of the cloned schema containing account usage details. When using a cloned or copied version, verify that the table or view definition remains unchanged as in your SNOWFLAKE database. If the format is different. For example, a column is missing and it no longer qualifies as a clone. (Optional) To preview and query existing assets ​ To query and preview data within assets that already exist in Snowflake, add these permissions: GRANT USAGE ON DATABASE \"\" TO ROLE atlan_user_role ; GRANT USAGE ON ALL SCHEMAS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL EXTERNAL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL MATERIALIZED VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON ALL STREAMS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT MONITOR ON PIPE \"\" TO ROLE atlan_user_role ; Replace with the database you want to be able to preview and query in Atlan. (Repeat the statements for every database you wish to preview and query in Atlan.) (Optional) To preview and query future assets ​ To query and preview data within assets that may be created in the future in Snowflake, add these permissions. Again, if you want to also be able to preview and query the data for future assets, you can add the preview and query future assets permissions instead. GRANT USAGE ON FUTURE SCHEMAS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE EXTERNAL TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE MATERIALIZED VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE STREAMS IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT MONITOR ON FUTURE PIPES IN DATABASE \"\" TO ROLE atlan_user_role ; Replace with the database you want to be able to preview and query in Atlan. (Repeat the statements for every database you want to preview and query in Atlan.) danger For any future grants defined at a schema level to a different role, the schema-level grants take precedence over the database-level grants and any future grants defined at a database level to the Atlan role get ignored. To learn more, refer to Snowflake documentation . To grant permissions at a schema level: GRANT SELECT ON FUTURE TABLES IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE EXTERNAL TABLES IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE VIEWS IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE MATERIALIZED VIEWS IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT SELECT ON FUTURE STREAMS IN SCHEMA \".\" TO ROLE atlan_user_role ; GRANT MONITOR ON FUTURE PIPES IN SCHEMA \".\" TO ROLE atlan_user_role ; Replace with the database and with the schema you want to be able to preview and query in Atlan. (Repeat the statements for every database and schema you want to preview and query in Atlan.) danger Verify that all the assets you'd like to crawl are present in these grants by checking the grants on the user role defined for the crawler. (Optional) To import Snowflake tags ​ Snowflake stores all tag objects in the ACCOUNT_USAGE schema. Note that object tagging in Snowflake currently requires Enterprise Edition or higher . To import tags from Snowflake , grant these permissions: To use the default SNOWFLAKE database and ACCOUNT_USAGE schema and also mine Snowflake's query history (for lineage), grant these permissions: USE ROLE ACCOUNTADMIN ; GRANT IMPORTED PRIVILEGES ON DATABASE SNOWFLAKE TO ROLE atlan_user_role ; The ACCOUNTADMIN role is required to grant privileges on the SNOWFLAKE database due to the following reasons: By default, only the ACCOUNTADMIN role can access the SNOWFLAKE database. To enable other roles to access the database and schemas and query the views, a user with the ACCOUNTADMIN role needs to grant IMPORTED PRIVILEGES on the SNOWFLAKE database to the desired roles. To use a copied or cloned version of this default schema, where you can also remove any sensitive data for security purposes, grant these permissions: GRANT USAGE ON DATABASE \"\" TO ROLE atlan_user_role ; GRANT USAGE ON SCHEMA \"\" IN DATABASE \"\" TO ROLE atlan_user_role ; GRANT REFERENCES ON ALL VIEWS IN DATABASE \"\" TO ROLE atlan_user_role ; Replace with the copied Snowflake database name. Replace with the copied Snowflake ACCOUNT_USAGE schema name. The grants for the copied version can't be used on the original SNOWFLAKE database. This is because Snowflake produces an error that granular grants can't be given to imported databases. (Optional) To push updated tags to Snowflake ​ To push tags updated for assets in Atlan to Snowflake , grant these permissions: GRANT APPLY TAG ON ACCOUNT TO ROLE < role - name > ; You can learn more about tag privileges from Snowflake documentation . (Optional) To crawl dynamic tables ​ Atlan currently supports fetching metadata for dynamic tables using the MONITOR privilege. Refer to Snowflake documentation to learn more. To crawl existing dynamic tables from Snowflake: Grant permissions at a database level: GRANT MONITOR ON ALL DYNAMIC TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; Grant permissions at a schema level: GRANT MONITOR ON ALL DYNAMIC TABLES IN SCHEMA \".\" TO ROLE atlan_user_role ; To crawl future dynamic tables from Snowflake: Grant permissions at a database level: GRANT MONITOR ON FUTURE DYNAMIC TABLES IN DATABASE \"\" TO ROLE atlan_user_role ; Grant permissions at a schema level: GRANT MONITOR ON FUTURE DYNAMIC TABLES IN SCHEMA \".\" TO ROLE atlan_user_role ; Replace with the database and with the schema you want to crawl in Atlan. (Repeat the statements for every database and schema you want to integrate into Atlan.) (Optional) To crawl Iceberg tables ​ Atlan currently supports fetching metadata for Iceberg tables only for the information schema extraction method. To crawl Iceberg tables from Snowflake, grant the following permissions: To crawl existing Iceberg tables in Snowflake: GRANT REFERENCES ON ALL ICEBERG TABLES IN DATABASE < database - name > TO ROLE atlan_user_role ; To crawl future Iceberg tables in Snowflake: GRANT REFERENCES ON FUTURE ICEBERG TABLES IN DATABASE < database - name > TO ROLE atlan_user_role ; To crawl Iceberg catalog metadata for Iceberg tables in Snowflake: GRANT USAGE ON INTEGRATION < integration - name > TO ROLE atlan_user_role ; danger You must first grant permissions to crawl existing Iceberg tables for this permission to work on catalogs. You must also grant permissions to all the catalogs you want to crawl in Atlan individually. (Optional) To crawl Snowflake stages ​ Atlan supports crawling metadata for Snowflake stages using the USAGE and READ privileges. For more information, see the Snowflake documentation for INFORMATION_SCHEMA.STAGES. To crawl stages from Snowflake: Grant USAGE and READ privileges on all existing stages at the database level: GRANT USAGE ON ALL STAGES IN DATABASE < database_name > TO ROLE atlan_user_role ; GRANT READ ON ALL STAGES IN DATABASE < database_name > TO ROLE atlan_user_role ; Replace with the name of your Snowflake database Replace with the role you've granted Atlan to use for crawling. Grant USAGE and READ privileges on all future stages at the database level: GRANT USAGE ON FUTURE STAGES IN DATABASE < database_name > TO ROLE atlan_user_role ; GRANT READ ON FUTURE STAGES IN DATABASE < database_name > TO ROLE atlan_user_role ; Replace with the name of your Snowflake database Replace with the role you've granted Atlan to use for crawling. Allowlist the Atlan IP ​ If you are using the IP allowlist in your Snowflake instance, you must add the Atlan IP to the allowlist. Please raise a support ticket from within Atlan, or submit a request . (If you aren't using the IP allowlist in your Snowflake instance, you can skip this step.) Tags: connectors data crawl Previous Snowflake Next Set up an AWS private network link to Snowflake Create user and role in Snowflake Choose metadata fetching method Grant permissions for account usage method Grant permissions for information schema method Allowlist the Atlan IP", "links": [ "https://docs.atlan.com/tags/crawl", "https://docs.atlan.com/product/connections/how-tos/manage-connectivity", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/references/multiple-tag-values-and-concatenation", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/mine-snowflake", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/manage-snowflake-tags", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/enable-snowflake-oauth", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/best-practices/snowflake-warehouse-configuration", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/set-up-an-aws-private-network-link-to-snowflake", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/set-up-snowflake", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/crawl-snowflake", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/troubleshooting/troubleshooting-snowflake-connectivity", "https://docs.atlan.com/", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/set-up-an-azure-private-network-link-to-snowflake", "https://docs.atlan.com/tags/connectors", "https://docs.atlan.com/tags/data", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443526.637111, "source": "docs" }, { "url": "https://docs.atlan.com/secure-agent", "title": "Secure Agent | Atlan Documentation", "content": "Connect data Secure Agent On this page Secure Agent The Atlan Secure Agent is a lightweight, Kubernetes-based application that enables secure metadata extraction. It connects internal systems with Atlan SaaS while keeping sensitive data protected and doesn’t require inbound connectivity. Running within an organization’s controlled environment, the Secure Agent ensures compliance with security policies and automates metadata processing. Figure 1: The Secure Agent runs in the customer environment and acts as a gateway. Key capabilities ​ The Secure Agent is designed for secure, scalable, and efficient metadata extraction. Security-first architecture ​ Runs entirely within the organization's infrastructure, preventing secrets from leaving its boundary. Uses outbound, encrypted communication to interact with Atlan SaaS. Supports logging and monitoring and integrates with external monitoring systems for auditing and compliance. Scalable metadata extraction ​ A single deployment of the Agent can connect to multiple source systems. Supports multiple concurrent metadata extraction jobs. Uses Kubernetes-based workloads for efficient resource management. Flexible deployment ​ Deploys on cloud-based Kubernetes environments (such as Amazon EKS, Azure AKS, and Google GKE) or on-premises clusters. Scales dynamically based on workload demands. Automated operations ​ Continuously monitors system health and sends heartbeats to Atlan. Captures and uploads execution logs for troubleshooting and auditing. Provides performance insights through metrics and alerts. How it works ​ The Secure Agent follows a job-based execution model where metadata extraction tasks are scheduled and executed within the organization's environment. The workflow typically involves: Atlan triggers a metadata extraction job. The Secure Agent retrieves job details and extracts metadata using source-specific connectors. Extracted metadata is shared with Atlan either through cloud storage or direct ingestion. Atlan workflows process the extracted metadata and publish the assets. Logs and execution status are sent to Atlan for monitoring and auditing. See also ​ Deployment architecture : Learn more about how the Secure Agent integrates with your environment and supports secure metadata extraction. Tags: security access-control permissions Next Install on Virtual Machine (K3s) Key capabilities How it works See also", "links": [ "https://docs.atlan.com/tags/security", "https://docs.atlan.com/tags/access-control", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/secure-agent/how-tos/k3s/install-secure-agent-on-virtual-machine-k3s", "https://docs.atlan.com/secure-agent/references/deployment-architecture", "https://docs.atlan.com/secure-agent/references/security", "https://docs.atlan.com/secure-agent", "https://docs.atlan.com/tags/permissions", "https://docs.atlan.com/secure-agent/how-tos/configure-secure-agent-for-workflow-execution", "https://docs.atlan.com/", "https://docs.atlan.com/secure-agent/how-tos/aws-eks/install-secure-agent-on-aws-eks", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443527.7848399, "source": "docs" }, { "url": "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/faq/power-bi-dataflow-datasource", "title": "What is the difference between a Power BI data source and dataflow? | Atlan Documentation", "content": "Connect data BI Tools On-premises & Enterprise BI Microsoft Power BI FAQ What is the difference between a Power BI data source and dataflow? What is the difference between a Power BI data source and dataflow? In Microsoft Power BI: Data source - a data source is any source that fuels a dataset. You can connect to different types of data sources, such as databases, files, Microsoft Fabric, and more, to fetch data directly into Microsoft Power BI for creating reports and dashboards. For a full list, refer to Microsoft Power BI documentation . Dataflows - data flows help you encode the process of extracting and transforming data from a data source to produce a dataset. These have a refresh frequency that keeps the dataset in sync with the data source. To learn more, refer to Microsoft Power BI documentation . Tags: data model Previous Troubleshooting Microsoft Power BI connectivity", "links": [ "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/faq/power-bi-dataflow-datasource", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/troubleshooting/troubleshooting-microsoft-power-bi-connectivity", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-does-atlan-crawl-from-microsoft-power-bi", "https://docs.atlan.com/tags/model", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/crawl-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi", "https://docs.atlan.com/", "https://docs.atlan.com/tags/data", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443528.860755, "source": "docs" }, { "url": "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/troubleshooting/troubleshooting-microsoft-power-bi-connectivity", "title": "Troubleshooting Microsoft Power BI connectivity | Atlan Documentation", "content": "Connect data BI Tools On-premises & Enterprise BI Microsoft Power BI Troubleshooting Troubleshooting Microsoft Power BI connectivity On this page Troubleshooting Microsoft Power BI connectivity What are the known limitations of the Microsoft Power BI connector? ​ Atlan currently doesn't support the following: Filtering hidden pages in reports - known limitation of PowerBI reports API Crawling reports developed and published in Power BI Report Server What are the limitations of the Microsoft PowerBI Connector, when only admin APIs are used? ​ When the Microsoft PowerBI Connector is configured to use only admin APIs, it results in reduced metadata extraction and limited lineage capabilities compared to using a combination of admin & non-admin APIs . The following limitations apply as mentioned below: PowerBI Pages (which are a part of PowerBI Report) won't be catalogued. Downstream Lineage from PowerBI Table Column / Measure -> PowerBI Page won't be available. Can users who don't have access to a report still see the preview? ​ Users can only see asset previews if the following conditions are met: They have the necessary permissions in both Microsoft Power BI and Atlan. They're logged into Atlan and Microsoft Power BI on the same browser. Therefore, if a user lacks the permission to view a report in Microsoft Power BI, they won't be able to see the report preview in Atlan. Even if they do have the necessary permissions, they need to be logged into Microsoft Power BI on the same browser as their Atlan instance for asset previews to work. Why can I not see previews for my Microsoft Power BI assets? ​ Your Microsoft Power BI assets are updated with previews during the next run of your Microsoft Power BI workflow. If you have run the workflow and still don't see the previews, rerun the workflow. Once you've rerun the workflow, the previews are visible to all eligible users. How does Atlan calculate views for Microsoft Power BI reports and dashboards? ​ Atlan calculates Usage views based on the number of times users open a report or dashboard in Microsoft Power BI. Tags: lineage data-lineage impact-analysis upstream-dependencies data-sources Previous What lineage does Atlan extract from Microsoft Power BI? Next What is the difference between a Power BI data source and dataflow?", "links": [ "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/faq/power-bi-dataflow-datasource", "https://docs.atlan.com/product/capabilities/usage-and-popularity/how-tos/interpret-usage-metrics", "https://docs.atlan.com/tags/upstream-dependencies", "https://docs.atlan.com/tags/data-lineage", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/tags/data-sources", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/troubleshooting/troubleshooting-microsoft-power-bi-connectivity", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-does-atlan-crawl-from-microsoft-power-bi", "https://docs.atlan.com/tags/impact-analysis", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/crawl-microsoft-power-bi", "https://docs.atlan.com/tags/lineage", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-lineage-does-atlan-extract-from-microsoft-power-bi", "https://docs.atlan.com/", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443530.090863, "source": "docs" }, { "url": "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-does-atlan-crawl-from-microsoft-power-bi", "title": "What does Atlan crawl from Microsoft Power BI? | Atlan Documentation", "content": "Connect data BI Tools On-premises & Enterprise BI Microsoft Power BI References What does Atlan crawl from Microsoft Power BI? On this page What does Atlan crawl from Microsoft Power BI? Atlan crawls and maps the following assets and properties from Microsoft Power BI. Once you've crawled Microsoft Power BI , you can use connector-specific filters for quick asset discovery. The following filters are currently supported for these assets: Measures - External measure filter danger Currently Atlan only represents the assets marked with πŸ”€ in lineage. For your Microsoft Power BI reports , Atlan also provides asset previews to help with quick discovery and give you the context you need. Apps ​ Atlan maps Apps from Microsoft Power BI to its PowerBIApp asset type. Source Property Atlan Property Where in Atlan name name asset profile and overview id powerBIAppId properties description description asset profile and overview publishedBy sourceOwners overview users ( displayName, appUserAccessRight ) powerBIAppUsers asset profile groups ( displayName, appUserAccessRight ) powerBIAppGroups asset profile Workspaces ​ Atlan maps workspaces from Microsoft Power BI to its PowerBIWorkspace asset type. Source property Atlan property Where in Atlan name name asset profile and overview description description asset profile and overview reportCount reportCount asset preview and profile dashboardCount dashboardCount asset profile datasetCount datasetCount asset profile dataflowCount dataflowCount asset profile webUrl sourceURL overview Dashboards πŸ”€ ​ Atlan maps dashboards from Microsoft Power BI to its PowerBIDashboard asset type. Source property Atlan property Where in Atlan displayName name asset profile and overview workspace_name workspaceName API only description description asset profile and overview tileCount tileCount asset profile webUrl sourceURL overview Data sources ​ Atlan maps data sources from Microsoft Power BI to its PowerBIDatasource asset type. Source property Atlan property Where in Atlan name name asset profile and overview connectionDetails connectionDetails overview Datasets πŸ”€ ​ Atlan maps datasets from Microsoft Power BI to its PowerBIDataset asset type. Source property Atlan property Where in Atlan name name asset profile and overview workspace_name workspaceName API only description description asset profile and overview webUrl sourceURL overview configuredBy sourceOwners asset profile and properties createdDate sourceCreatedAt asset profile and properties endorsementDetails certificateStatus (VERIFIED) asset profile and overview endorsementDetails (endorsement) certificateStatusMessage , powerBIEndorsement asset profile and overview endorsementDetails (certifiedBy) certificateUpdatedBy asset profile and overview Dataflows πŸ”€ ​ Atlan maps dataflows from Microsoft Power BI to its PowerBIDataflow asset type. Atlan currently only supports dataflow lineage for the following SQL sources: Microsoft SQL Server Oracle SAP HANA Snowflake Source property Atlan property Where in Atlan name name asset profile and overview workspace_name workspaceName API only description description asset profile and overview webUrl sourceURL overview configuredBy sourceOwners asset profile and properties modifiedDateTime sourceUpdatedAt asset profile and properties endorsementDetails certificateStatus (VERIFIED) asset profile and overview endorsementDetails (endorsement) certificateStatusMessage , powerBIEndorsement asset profile and overview endorsementDetails (certifiedBy) certificateUpdatedBy asset profile and overview modifiedBy sourceUpdatedBy asset profile and properties days powerBIDataflowRefreshScheduleFrequency properties times powerBIDataflowRefreshScheduleTimes properties localTimeZoneId powerBIDataflowRefreshScheduleTimeZone properties Dataflow entity columns πŸ”€ ​ Atlan maps attributes of dataflow entities from Microsoft Power BI to its PowerBIDataflowEntityColumn asset type. Source property Atlan property Where in Atlan attrbutes.name name asset profile and overview entities.name powerBIDataflowEntityName overview attributes.$type powerBIDataflowEntityColumnDataType asset profile and overview Reports πŸ”€ ​ Atlan maps reports from Microsoft Power BI to its PowerBIReport asset type. Source property Atlan property Where in Atlan name name asset profile and overview workspace_name workspaceName API only description description asset profile and overview pageCount pageCount asset profile webUrl sourceURL overview createdDateTime sourceCreatedAt asset profile and properties modifiedDateTime sourceUpdatedAt asset profile and properties createdBy sourceCreatedBy , sourceOwners asset profile and properties modifiedBy sourceUpdatedBy asset profile and properties endorsementDetails certificateStatus (VERIFIED) asset profile and overview endorsementDetails (endorsement) certificateStatusMessage , powerBIEndorsement asset profile and overview endorsementDetails (certifiedBy) certificateUpdatedBy asset profile and overview Pages πŸ”€ ​ Atlan maps pages from Microsoft Power BI to its PowerBIPage asset type. Source property Atlan property Where in Atlan displayName name asset profile and overview workspace_name workspaceName API only report_name reportName API only Tiles πŸ”€ ​ Atlan maps tiles from Microsoft Power BI to its PowerBITile asset type. Source property Atlan property Where in Atlan title name asset profile and overview subTitle description asset profile and overview workspace_name workspaceName API only dashboard_name dashboardName API only Tables πŸ”€ ​ Atlan maps tables from Microsoft Power BI to its PowerBITable asset type. Source property Atlan property Where in Atlan name name asset profile and overview description description asset profile and overview isHidden isHidden API only sourceExpressions powerBITableSourceExpressions API only columnCount powerBITableColumnCount asset profile and preview measureCount powerBITableMeasureCount asset profile and preview Columns πŸ”€ ​ Atlan maps columns from Microsoft Power BI to its PowerBIColumn asset type. Source property Atlan property Where in Atlan name name asset profile and overview description description asset profile and overview isHidden powerBIIsHidden API only dataCategory powerBIColumnDataCategory API only dataType powerBIColumnDataType asset preview and overview formatString powerBIFormatString API only sortByColumn powerBISortByColumn API only summarizeBy powerBIColumnSummarizeBy API only Measures πŸ”€ ​ Atlan maps measures from Microsoft Power BI to its PowerBIMeasure asset type. Atlan supports PowerBI Measures for downstream lineage to a PowerBI Page. Source property Atlan property Where in Atlan name name asset profile and overview description description asset profile and overview isHidden powerBIIsHidden API only expression powerBIMeasureExpression overview isExternalMeasure powerBIIsExternalMeasure asset filter formatString powerBIFormatString API only Tags: connectors crawl Previous Mine Microsoft Power BI Next Preflight checks for Microsoft Power BI Apps Workspaces Dashboards πŸ”€ Data sources Datasets πŸ”€ Dataflows πŸ”€ Dataflow entity columns πŸ”€ Reports πŸ”€ Pages πŸ”€ Tiles πŸ”€ Tables πŸ”€ Columns πŸ”€ Measures πŸ”€", "links": [ "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/faq/power-bi-dataflow-datasource", "https://docs.atlan.com/tags/crawl", "https://docs.atlan.com/apps/connectors/database/microsoft-sql-server/how-tos/set-up-microsoft-sql-server", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/troubleshooting/troubleshooting-microsoft-power-bi-connectivity", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-does-atlan-crawl-from-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/crawl-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/set-up-snowflake", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/preflight-checks-for-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-lineage-does-atlan-extract-from-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi", "https://docs.atlan.com/apps/connectors/database/sap-hana/how-tos/set-up-sap-hana", "https://docs.atlan.com/", "https://docs.atlan.com/apps/connectors/database/oracle/how-tos/set-up-oracle", "https://docs.atlan.com/tags/connectors", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/mine-microsoft-power-bi", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443531.266727, "source": "docs" }, { "url": "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/crawl-microsoft-power-bi", "title": "Crawl Microsoft Power BI | Atlan Documentation", "content": "Connect data BI Tools On-premises & Enterprise BI Microsoft Power BI Crawl Power BI Assets Crawl Microsoft Power BI On this page Crawl Microsoft Power BI Once you have configured the Microsoft Power BI user permissions , you can establish a connection between Atlan and Microsoft Power BI. To crawl metadata from Microsoft Power BI, review the order of operations and then complete the following steps. Select the source ​ To select Microsoft Power BI as your source: In the top right of any screen, navigate to New and then click New Workflow . From the list of packages, select Power BI Assets and click on Setup Workflow . Provide credentials ​ To enter your Microsoft Power BI credentials: For Authentication, choose the method you want to use to access Microsoft Power BI: For Service Principal authentication, enter the Tenant Id , Client Id , and Client Secret you configured when setting up Microsoft Power BI . Use the Enable Only Admin API Access option to control how metadata is extracted. When enabled, the crawler uses only admin APIs. If disabled, both admin and non-admin APIs are used. For Delegated User authentication, enter the Username , Password , Tenant Id , Client Id , and Client Secret you configured when setting up Microsoft Power BI . At the bottom of the form, click the Test Authentication button to confirm connectivity to Microsoft Power BI using these details. Once successful, at the bottom of the screen click the Next button. Configure connection ​ To complete the Microsoft Power BI connection configuration: Provide a Connection Name that represents your source environment. For example, you might want to use values like production , development , gold , or analytics . (Optional) To change the users able to manage this connection, change the users or groups listed under Connection Admins . danger If you don't specify any user or group, nobody can manage the connection - not even admins. At the bottom of the screen, click the Next button to proceed. Configure the crawler ​ Before running the Microsoft Power BI crawler, configure metadata extraction and advanced options. You can override the default settings for the following fields. Configure metadata ​ Include Workspaces : Select Microsoft Power BI workspaces to include. Defaults to all workspaces when left blank. Use Advanced Search to filter workspaces using the following options: Contains : Matches workspaces that contain the given substring. Starts with : Matches workspaces that begin with the specified text. Ends with : Matches workspaces that end with the specified text. Regex pattern : Matches workspaces based on a regular expression. All selected filters apply using an AND condition. Exclude Workspaces : Select workspaces to exclude. No workspaces are excluded by default. Advanced Search is also available for exclusion, with the same filtering options as mentioned previously. Include Dashboard and Reports Regex : Use a regular expression to include dashboards and reports based on naming patterns. Includes all by default. Exclude Dashboard and Reports Regex : Use a regular expression to exclude dashboards and reports based on naming patterns. Excludes none by default. Attach Endorsements from Power BI : Automatically certify assets endorsed in Power BI. To manually review before applying, change this setting to Send a Request . For more details, see What does Atlan crawl from Microsoft Power BI? Configure advanced settings ​ Source Connections : When your tenant has multiple connections available for the same source system that share the similar metadata, confirm the advanced options and choose the correct connections from the Source Connections list drop down to avoid creating duplicate lineage to such connections. Enable ODBC DSN Connectivity Mapping : Power BI provides multiple ways of connecting to a SQL source, including ODBC connectivity for building Reports and Dashboards. When datasets are populated using ODBC, provide a mapping of the DSN ( Data Source Name ) names to their appropriate database qualified names after enabling this toggle. Did you know? If a workspace appears in both the include and exclude filters, the exclude filter takes precedence. Run the crawler ​ To run the Microsoft Power BI crawler: To check for any permissions or other configuration issues before running the crawler, click Preflight checks . You can either: To run the crawler once immediately, at the bottom of the screen, click the Run button. To schedule the crawler to run hourly, daily, weekly, or monthly, at the bottom of the screen, click the Schedule Run button. Once the crawler has completed running, you can see the assets in Atlan's asset page! πŸŽ‰ Tags: connectors data crawl Previous Set up Microsoft Power BI Next Mine Microsoft Power BI Select the source Provide credentials Configure connection Configure the crawler Run the crawler", "links": [ "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/faq/power-bi-dataflow-datasource", "https://docs.atlan.com/tags/crawl", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/troubleshooting/troubleshooting-microsoft-power-bi-connectivity", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-does-atlan-crawl-from-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/crawl-microsoft-power-bi", "https://docs.atlan.com/product/connections/how-tos/order-workflows", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/preflight-checks-for-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi", "https://docs.atlan.com/", "https://docs.atlan.com/tags/connectors", "https://docs.atlan.com/tags/data", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/mine-microsoft-power-bi", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443532.37341, "source": "docs" }, { "url": "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi", "title": "Microsoft Power BI | Atlan Documentation", "content": "Connect data BI Tools On-premises & Enterprise BI Microsoft Power BI On this page Microsoft Power BI Overview: Catalog workspaces, reports, dashboards, and datasets from Microsoft Power BI in Atlan to enable discovery, lineage, and governance for your analytics assets. Get started ​ Follow these steps to connect and catalog Power BI assets in Atlan: Set up the connector Crawl Microsoft Power BI assets Guides ​ Mine Power BI usage : Extract usage metrics and activity events from Power BI. References ​ What does Atlan crawl from Microsoft Power BI : Learn about the Power BI assets and metadata that Atlan discovers and catalogs. What lineage does Atlan extract from Microsoft Power BI : Learn about supported lineage extraction for Power BI assets. Preflight checks for Microsoft Power BI : Verify prerequisites before setting up the Microsoft Power BI connector. Troubleshooting ​ Troubleshooting connectivity : Resolve common Power BI connection issues and errors. Tags: power bi connector business intelligence connectivity Next Set up Microsoft Power BI Get started Guides References Troubleshooting", "links": [ "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/faq/power-bi-dataflow-datasource", "https://docs.atlan.com/tags/business-intelligence", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/troubleshooting/troubleshooting-microsoft-power-bi-connectivity", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-does-atlan-crawl-from-microsoft-power-bi", "https://docs.atlan.com/tags/power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/crawl-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/preflight-checks-for-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/references/what-lineage-does-atlan-extract-from-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi", "https://docs.atlan.com/", "https://docs.atlan.com/tags/connectivity", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/mine-microsoft-power-bi", "https://docs.atlan.com/tags/connector", "https://docs.atlan.com/get-started/what-is-atlan" ], "timestamp": 1757443533.603783, "source": "docs" }, { "url": "https://docs.atlan.com/tags/authentication", "title": "53 docs tagged with \"authentication\" | Atlan Documentation", "content": "53 docs tagged with \"authentication\" View all tags Add impact analysis in GitHub Learn about add impact analysis in github. Add impact analysis in GitLab Learn about add impact analysis in gitlab. Authentication Understand how Secure Agent 2.0 authentication works and why it protects your enterprise infrastructure. Create an AWS Lambda trigger Once you have configured the [AWS Lambda permissions](/product/integrations/automation/aws-lambda/how-tos/set-up-aws-lambda), you can run an AWS Lambda function. Enable Snowflake OAuth Atlan supports [Snowflake OAuth-based authentication](https://docs.snowflake.com/user-guide/oauth-snowflake-overview) for [Snowflake](/apps/connectors/data-ware. Enable SSO for Amazon Redshift You will need to [create a client application in Okta](https://help.okta.com/en-us/Content/Topics/Apps/Apps_App_Integration_Wizard_OIDC.htm) to use for [configuring the identity provider in AWS](/apps/connectors/data-warehouses/amazon-redshift/how-tos/enable-sso-for-amazon-redshift). Enable SSO for Google BigQuery Credentials are used to obtain an access token from Google's authorization servers for authentication in Atlan. extract lineage and usage from Databricks Once you have [crawled assets from Databricks](/apps/connectors/data-warehouses/databricks/how-tos/crawl-databricks), you can retrieve lineage from [Unity Catalog](https://docs.databricks.com/data-governance/unity-catalog/index.html) and [usage and popularity metrics](/product/capabilities/usage-and-popularity/how-tos/interpret-usage-metrics) from [query history](https://docs.databricks.com/api/workspace/queryhistory/list) or system tables. This is supported for all [three authentication methods](/apps/connectors/data-warehouses/databricks/how-tos/set-up-databricks): personal access token, AWS service principal, and Azure service principal. Integrate Anomalo Once you have [configured the Anomalo settings](/apps/connectors/observability/anomalo/how-tos/set-up-anomalo), you can establish a connection between Atlan and Anomalo. Integrate Apache Spark/OpenLineage Atlan extracts job-level operational metadata from Apache Spark and generates job lineage through OpenLineage. To learn more about OpenLineage, refer to [OpenLineage configuration and facets](/product/connections/references/openlineage-configuration-and-facets). PingFederate SSO 404 error If you're encountering a 404 error while using PingFederate single sign-on (SSO), it is possible that the authentication request requires a signed assertion. Preflight checks for Google BigQuery Each request requires an OAuth 2.0 access token generated via the [service account key](https://cloud.google.com/docs/authentication#service-accounts). Preflight checks for Microsoft Azure Synapse Analytics This check is performed for both [basic](/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/how-tos/set-up-microsoft-azure-synapse-analytics) and [service principal](/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/how-tos/set-up-microsoft-azure-synapse-analytics) authentication method. Security The Secure Agent is designed with multiple security controls to protect metadata, credentials, and communication between systems. This document outlines its security mechanisms across authentication, encryption, container security, network security, and logging and monitoring. Security and Compliance Complete guide to Atlan's security features, compliance certifications, and data protection capabilities. Set up Amazon DynamoDB Learn about set up amazon dynamodb. Set up Amazon MSK Learn about set up amazon msk. Set up Amazon QuickSight Learn about set up amazon quicksight. Set up Amazon Redshift :::warning Who can do this? You will need your Amazon Redshift administrator to run these commands - you may not have access yourself. Set up Anomalo Atlan supports the API authentication method for fetching metadata from [Anomalo](https://docs.anomalo.com/integrations/atlan-integration). This method uses an API key to fetch metadata. Set up client credentials flow Configure Salesforce for OAuth 2.0 client credentials authentication in Atlan. Set up Confluent Kafka Atlan supports the API authentication method for fetching metadata from Confluent Kafka. This method uses an API key and API secret to fetch metadata. Set up Confluent Schema Registry :::warning Who can do this? You will probably need your Schema Registry administrator to complete these steps - you may not have access yourself. Set up Databricks Atlan supports three authentication methods for fetching metadata from Databricks. You can set up any of the following authentication methods:. Set up Domo :::warning Who can do this? You will need your Domo administrator to complete these steps - you may not have access yourself. Set up Hive :::warning Who can do this? You will need your Hadoop administrator to run these commands - you may not have access yourself. Set up IBM Cognos Analytics :::warning Who can do this? You must be an IBM Cognos Analytics administrator to complete these steps - you may not have access yourself. Set up Informatica CDI Configure authentication and user permissions for Informatica Cloud Data Integration connector Set up JWT bearer flow Configure Salesforce for OAuth 2.0 JWT bearer authentication for Atlan. Set up Microsoft Azure Cosmos DB If your Microsoft Azure Cosmos DB deployment includes a mix of vCore- and RU-based accounts, you must configure both to fetch metadata. You can then use the _vCore and RU_ deployment option to [crawl your Microsoft Azure Cosmos DB assets](/apps/connectors/database/microsoft-azure-cosmos-db/how-tos/crawl-microsoft-azure-cosmos-db). Set up Microsoft Azure Data Factory Atlan supports service principal authentication for fetching metadata from Microsoft Azure Data Factory. This method requires a client ID, client secret, and tenant ID to fetch metadata. Set up Microsoft Azure Event Hubs Atlan supports the following authentication methods for Microsoft Azure Event Hubs:. Set up Microsoft Azure Synapse Analytics Atlan supports crawling the following with the Microsoft Azure Synapse Analytics package:. Set up Microsoft Power BI This guide outlines how to set up Microsoft Power BI so it can connect with Atlan for metadata extraction and lineage tracking. Set up Microsoft SQL Server :::warning Who can do this? You will probably need your Microsoft SQL Server administrator to run these commands - you may not have access yourself. Set up MicroStrategy Atlan supports the basic authentication method for fetching metadata from MicroStrategy. This method uses a username and password to fetch metadata. Set up MongoDB Atlan supports the basic authentication method for fetching metadata from MongoDB. This method uses a [username and password](#create-database-user-in-mongodb) to fetch metadata. Set up Monte Carlo :::warning Who can do this? You will probably need your Monte Carlo [account owner](https://docs.getmontecarlo.com/docs/authorizationmanaged-roles-and-groups). Set up MySQL :::warning Who can do this? You will probably need your MySQL administrator to run these commands - you may not have access yourself. Set up Oracle :::warning Who can do this? You need your Oracle database administrator or a similar role to run these commands - you may not have access yourself. Set up PrestoSQL Learn about set up prestosql. Set up Redash :::warning Who can do this? You will probably need your Redash administrator to complete the following steps - you may not have access yourself. Set up Salesforce Learn about setting up Salesforce authentication for Atlan. Set up SAP HANA :::warning Who can do this? You will probably need your SAP HANA administrator to run these commands - you may not have access yourself. Set up Sisense Atlan supports the basic authentication method for fetching metadata from Sisense. This method uses a username and password to fetch metadata. Set up Soda :::warning Who can do this? You will need your [Soda Cloud administrator](https://docs.soda.io/soda-cloud/roles-and-rights.html) to complete these steps -. Set up Teradata :::warning Who can do this? You will probably need your Teradata administrator to run these commands - you may not have access yourself. Set up ThoughtSpot :::warning Who can do this? You will probably need your ThoughtSpot instance administrator to complete these steps - you may not have access yourself. Set up Trino :::warning Who can do this? You will probably need your Trino administrator to run these commands - you may not have access yourself. Set up username-password flow Configure Salesforce username-password flow for Atlan integration. Supported connections for on-premises databases The metadata-extractor tool supports the following connection types. Users and groups Learn how to manage users and groups in Atlan to control access and organize your data team. What does Atlan crawl from Domo? Atlan supports lineage for the following asset types:.", "links": [ "https://docs.atlan.com/apps/connectors/observability/soda/how-tos/set-up-soda", "https://docs.atlan.com/apps/connectors/etl-tools/dbt/how-tos/add-impact-analysis-in-gitlab", "https://docs.atlan.com/apps/connectors/database/amazon-dynamodb/how-tos/set-up-amazon-dynamodb", "https://docs.atlan.com/apps/connectors/crm/salesforce/how-tos/oauth-client-credentials-setup", "https://docs.atlan.com/apps/connectors/observability/monte-carlo/how-tos/set-up-monte-carlo", "https://docs.atlan.com/apps/connectors/database/trino/how-tos/set-up-trino", "https://docs.atlan.com/secure-agent/2.0/concepts/authentication", "https://docs.atlan.com/apps/connectors/messaging/amazon-msk/how-tos/set-up-amazon-msk", "https://docs.atlan.com/apps/connectors/messaging/confluent-kafka/how-tos/set-up-confluent-kafka", "https://docs.atlan.com/product/integrations/automation/aws-lambda/how-tos/create-an-aws-lambda-trigger", "https://docs.atlan.com/apps/connectors/database/oracle/how-tos/set-up-oracle", "https://docs.atlan.com/apps/connectors/database/sap-hana/how-tos/set-up-sap-hana", "https://docs.atlan.com/apps/connectors/crm/salesforce/how-tos/oauth-username-password-setup", "https://docs.atlan.com/apps/connectors/data-warehouses/google-bigquery/references/preflight-checks-for-google-bigquery", "https://docs.atlan.com/product/integrations/identity-management/sso/faq/pingfederate-404-error", "https://docs.atlan.com/apps/connectors/business-intelligence/amazon-quicksight/how-tos/set-up-amazon-quicksight", "https://docs.atlan.com/apps/connectors/database/hive/how-tos/set-up-hive", "https://docs.atlan.com/product/capabilities/governance/users-and-groups", "https://docs.atlan.com/get-started/what-is-atlan", "https://docs.atlan.com/apps/connectors/data-warehouses/google-bigquery/how-tos/enable-sso-for-google-bigquery", "https://docs.atlan.com/apps/connectors/database/mongodb/how-tos/set-up-mongodb", "https://docs.atlan.com/support/submit-request", "https://docs.atlan.com/apps/connectors/database/on-premises-databases/references/supported-connections-for-on-premises-databases", "https://docs.atlan.com/faq/security-and-compliance", "https://docs.atlan.com/secure-agent/references/security", "https://docs.atlan.com/apps/connectors/business-intelligence/sisense/how-tos/set-up-sisense", "https://docs.atlan.com/", "https://docs.atlan.com/apps/connectors/business-intelligence/redash/how-tos/set-up-redash", "https://docs.atlan.com/apps/connectors/business-intelligence/ibm-cognos-analytics/how-tos/set-up-ibm-cognos-analytics", "https://docs.atlan.com/apps/connectors/data-warehouses/snowflake/how-tos/enable-snowflake-oauth", "https://docs.atlan.com/apps/connectors/business-intelligence/microsoft-power-bi/how-tos/set-up-microsoft-power-bi", "https://docs.atlan.com/apps/connectors/database/prestosql/how-tos/set-up-prestosql", "https://docs.atlan.com/apps/connectors/lineage/apache-spark-openlineage/how-tos/integrate-apache-spark-openlineage", "https://docs.atlan.com/apps/connectors/database/microsoft-sql-server/how-tos/set-up-microsoft-sql-server", "https://docs.atlan.com/apps/connectors/messaging/microsoft-azure-event-hubs/how-tos/set-up-microsoft-azure-event-hubs", "https://docs.atlan.com/apps/connectors/etl-tools/microsoft-azure-data-factory/how-tos/set-up-microsoft-azure-data-factory", "https://docs.atlan.com/apps/connectors/database/mysql/how-tos/set-up-mysql", "https://docs.atlan.com/apps/connectors/etl-tools/dbt/how-tos/add-impact-analysis-in-github", "https://docs.atlan.com/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/how-tos/set-up-microsoft-azure-synapse-analytics", "https://docs.atlan.com/tags", "https://docs.atlan.com/apps/connectors/data-warehouses/amazon-redshift/how-tos/set-up-amazon-redshift", "https://docs.atlan.com/tags/authentication", "https://docs.atlan.com/apps/connectors/etl-tools/informatica-cdi/how-tos/set-up-informatica-cdi", "https://docs.atlan.com/apps/connectors/crm/salesforce/how-tos/set-up-salesforce", "https://docs.atlan.com/apps/connectors/data-warehouses/amazon-redshift/how-tos/enable-sso-for-amazon-redshift", "https://docs.atlan.com/apps/connectors/crm/salesforce/how-tos/oauth-jwt-bearer-setup", "https://docs.atlan.com/apps/connectors/business-intelligence/thoughtspot/how-tos/set-up-thoughtspot", "https://docs.atlan.com/apps/connectors/observability/anomalo/how-tos/set-up-anomalo", "https://docs.atlan.com/apps/connectors/data-warehouses/databricks/how-tos/set-up-databricks", "https://docs.atlan.com/apps/connectors/data-warehouses/databricks/how-tos/extract-lineage-and-usage-from-databricks", "https://docs.atlan.com/apps/connectors/database/microsoft-azure-cosmos-db/how-tos/set-up-microsoft-azure-cosmos-db", "https://docs.atlan.com/apps/connectors/business-intelligence/domo/references/what-does-atlan-crawl-from-domo", "https://docs.atlan.com/apps/connectors/schema/confluent-schema-registry/how-tos/set-up-confluent-schema-registry", "https://docs.atlan.com/apps/connectors/database/teradata/how-tos/set-up-teradata", "https://docs.atlan.com/apps/connectors/data-warehouses/microsoft-azure-synapse-analytics/references/preflight-checks-for-microsoft-azure-synapse-analytics", "https://docs.atlan.com/apps/connectors/business-intelligence/microstrategy/how-tos/set-up-microstrategy", "https://docs.atlan.com/apps/connectors/business-intelligence/domo/how-tos/set-up-domo", "https://docs.atlan.com/apps/connectors/observability/anomalo/how-tos/integrate-anomalo" ], "timestamp": 1757443534.712553, "source": "docs" }, { "url": "https://docs.atlan.com/tags/data", "title": "255 docs tagged with \"data\" | Atlan Documentation", "content": "255 docs tagged with \"data\" View all tags Access archived assets Learn about access archived assets. Add contract impact analysis in GitHub Add contract impact analysis in GitHub Add custom metadata