[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Step 2: Enable in Agent Space in AWS DevOps Agent.

[Assistant]
Associate the Datadog integration with one or more Agent Spaces.

1. Navigate to the Agent Space configuration.
2. Under **Telemetry Sources**, select **Add source**.
3. Choose the registered Datadog integration.
4. Configure which Datadog services or tags to scope the integration (optional).
5. Save the Agent Space configuration.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Step 3: Configure Webhooks in AWS DevOps Agent?

[Assistant]
Configure Datadog to send alert notifications to DevOps Agent when monitors trigger.

1. In Datadog, navigate to **Integrations > Webhooks**.
2. Create a new webhook:
   - **Name**: `aws-devops-agent`
   - **URL**: The webhook URL provided in the DevOps Agent console
   - **Payload**: Use the following JSON template:

```json
{
  "event_type": "alert",
  "source": "datadog",
  "monitor_id": "$ALERT_ID",
  "monitor_name": "$ALERT_TITLE",
  "status": "$ALERT_TRANSITION",
  "priority": "$ALERT_PRIORITY",
  "tags": "$TAGS",
  "hostname": "$HOSTNAME",
  "message": "$TEXT_ONLY_MSG",
  "snapshot_url": "$SNAPSHOT",
  "timestamp": "$DATE"
}
```

3. **Custom Headers**: Add the authentication header:
   - For HMAC: `X-Signature: <computed-hmac>`
   - For Bearer: `Authorization: Bearer <token>`

4. **Assign to monitors**: Add the `@webhook-aws-devops-agent` notification to the monitors you want to route to DevOps Agent.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Step 3: Configure Webhooks in AWS DevOps Agent.

[Assistant]
Configure Datadog to send alert notifications to DevOps Agent when monitors trigger.

1. In Datadog, navigate to **Integrations > Webhooks**.
2. Create a new webhook:
   - **Name**: `aws-devops-agent`
   - **URL**: The webhook URL provided in the DevOps Agent console
   - **Payload**: Use the following JSON template:

```json
{
  "event_type": "alert",
  "source": "datadog",
  "monitor_id": "$ALERT_ID",
  "monitor_name": "$ALERT_TITLE",
  "status": "$ALERT_TRANSITION",
  "priority": "$ALERT_PRIORITY",
  "tags": "$TAGS",
  "hostname": "$HOSTNAME",
  "message": "$TEXT_ONLY_MSG",
  "snapshot_url": "$SNAPSHOT",
  "timestamp": "$DATE"
}
```

3. **Custom Headers**: Add the authentication header:
   - For HMAC: `X-Signature: <computed-hmac>`
   - For Bearer: `Authorization: Bearer <token>`

4. **Assign to monitors**: Add the `@webhook-aws-devops-agent` notification to the monitors you want to route to DevOps Agent.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Capabilities in AWS DevOps Agent?

[Assistant]
With the Datadog integration, DevOps Agent can:

- Receive real-time monitor alert notifications
- Query metric timeseries data for specific hosts and services
- List and inspect monitor configurations
- Retrieve recent events and their context
- Correlate Datadog alerts with AWS resource state


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Capabilities in AWS DevOps Agent.

[Assistant]
With the Datadog integration, DevOps Agent can:

- Receive real-time monitor alert notifications
- Query metric timeseries data for specific hosts and services
- List and inspect monitor configurations
- Retrieve recent events and their context
- Correlate Datadog alerts with AWS resource state


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] How do I connect connecting datadog to AWS DevOps Agent?

[Assistant]
You can limit which Datadog data DevOps Agent can access by:

- Restricting the Application Key's scopes
- Using tag-based filtering when associating with Agent Spaces
- Configuring monitor-specific webhook notifications


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What's the process for integrating connecting datadog with AWS DevOps Agent?

[Assistant]
You can limit which Datadog data DevOps Agent can access by:

- Restricting the Application Key's scopes
- Using tag-based filtering when associating with Agent Spaces
- Configuring monitor-specific webhook notifications


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Troubleshooting in AWS DevOps Agent?

[Assistant]
- **Authentication failures**: Verify the API Key and Application Key are valid and have not been revoked.
- **Wrong endpoint**: Confirm you selected the correct Datadog site region.
- **Webhooks not firing**: Ensure the `@webhook-aws-devops-agent` mention is included in monitor notification messages.
- **Missing metrics**: Check that the Application Key has the `metrics_read` scope.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Troubleshooting in AWS DevOps Agent.

[Assistant]
- **Authentication failures**: Verify the API Key and Application Key are valid and have not been revoked.
- **Wrong endpoint**: Confirm you selected the correct Datadog site region.
- **Webhooks not firing**: Ensure the `@webhook-aws-devops-agent` mention is included in monitor notification messages.
- **Missing metrics**: Check that the Application Key has the `metrics_read` scope.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Give me a comprehensive overview of connecting dynatrace in AWS DevOps Agent.

[Assistant]
# Connecting Dynatrace

AWS DevOps Agent supports a 2-way integration with Dynatrace SaaS. This integration allows DevOps Agent to receive incident notifications from Dynatrace and actively query the Dynatrace environment for metrics, traces, logs, and topology data during investigations.

## Prerequisites

- Dynatrace SaaS environment (not Dynatrace Managed)
- Dynatrace account with admin permissions to create OAuth clients
- AWS DevOps Agent deployed and configured

## Onboarding

### Step 1: Connect (OAuth Client Setup)

Create an OAuth client in Dynatrace to allow DevOps Agent to authenticate.

1. In Dynatrace, navigate to **Account Management > Identity & access management > OAuth clients**.
2. Create a new OAuth client with the following scopes:
   - `storage:logs:read`
   - `storage:metrics:read`
   - `storage:events:read`
   - `storage:entities:read`
   - `storage:bizevents:read`
   - `environment-api:metrics:read`
   - `environment-api:entities:read`
   - `environment-api:events:read`
   - `environment-api:problems:read`
   - `environment-api:slo:read`
3. Note the client ID and client secret.
4. In the DevOps Agent console, navigate to **Telemetry Sources > Add > Dynatrace**.
5. Enter the OAuth client ID and client secret.

### Step 2: Enable (Environment and Entity Configuration)

Configure which Dynatrace environment and entities DevOps Agent should monitor.

1. Provide the **Environment ID** of your Dynatrace SaaS environment.
   - Found in your Dynatrace URL: `https://<environment-id>.live.dynatrace.com`
2. Specify **Entity IDs** to scope the integration:
   - Host groups
   - Management zones
   - Specific services or applications
3. Associate the Dynatrace connection with an Agent Space.

### Step 3: Configure Dynatrace Environment

Install and configure the SRE Agents app in your Dynatrace environment.

1. In Dynatrace, go to the **Hub** and install the **SRE Agents** app.
2. Open the SRE Agents app and configure the webhook destination:
   - Webhook URL: Provided in the DevOps Agent console after registration
   - Authentication: HMAC signature verification
3. Configure which problem types should trigger notifications to DevOps Agent.

## Supported Event Schemas

### Incident Events

Dynatrace sends incident events when problems are detected:

```json
{
  "event_type": "incident",
  "source": "dynatrace",
  "problem_id": "P-12345",
  "title": "High CPU on host-001",
  "severity": "CRITICAL",
  "status": "OPEN",
  "impact_level": "SERVICE",
  "affected_entities": [
    {
      "entity_id": "HOST-ABC123",
      "entity_type": "HOST",
      "entity_name": "host-001"
    }
  ],
  "root_cause": {
    "entity_id": "PROCESS_GROUP_INSTANCE-XYZ",
    "entity_type": "PROCESS_GROUP_INSTANCE"
  },
  "start_time": "2024-01-15T10:30:00Z"
}
```

### Mitigation Events

DevOps Agent can send mitigation actions back to Dynatrace:

```json
{
  "event_type": "mitigation",
  "source": "aws_devops_agent",
  "problem_id": "P-12345",
  "action": "scale_up",
  "status": "EXECUTED",
  "details": {
    "resource": "arn:aws:ecs:us-east-1:123456789012:service/my-service",
    "previous_count": 2,
    "new_count": 4
  },
  "timestamp": "2024-01-15T10:35:00Z"
}
```

## Capabilities

With the 2-way Dynatrace integration, DevOps Agent can:

- Receive real-time problem notifications
- Query metrics for affected entities
- Retrieve distributed traces for failing services
- Access log data related to detected problems
- Understand service topology and dependencies
- Correlate Dynatrace problems with AWS resource events
- Report mitigation actions taken back to Dynatrace

## Troubleshooting

- **OAuth errors**: Verify the client ID and secret, and ensure all required scopes are granted.
- **No events received**: Check that the SRE Agents app is installed and the webhook URL is correctly configured.
- **Missing data in queries**: Ensure the entity IDs are correct and the OAuth client has the necessary read scopes.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is connecting dynatrace?

[Assistant]
# Connecting Dynatrace

AWS DevOps Agent supports a 2-way integration with Dynatrace SaaS. This integration allows DevOps Agent to receive incident notifications from Dynatrace and actively query the Dynatrace environment for metrics, traces, logs, and topology data during investigations.

## Prerequisites

- Dynatrace SaaS environment (not Dynatrace Managed)
- Dynatrace account with admin permissions to create OAuth clients
- AWS DevOps Agent deployed and configured

## Onboarding

### Step 1: Connect (OAuth Client Setup)

Create an OAuth client in Dynatrace to allow DevOps Agent to authenticate.

1. In Dynatrace, navigate to **Account Management > Identity & access management > OAuth clients**.
2. Create a new OAuth client with the following scopes:
   - `storage:logs:read`
   - `storage:metrics:read`
   - `storage:events:read`
   - `storage:entities:read`
   - `storage:bizevents:read`
   - `environment-api:metrics:read`
   - `environment-api:entities:read`
   - `environment-api:events:read`
   - `environment-api:problems:read`
   - `environment-api:slo:read`
3. Note the client ID and client secret.
4. In the DevOps Agent console, navigate to **Telemetry Sources > Add > Dynatrace**.
5. Enter the OAuth client ID and client secret.

### Step 2: Enable (Environment and Entity Configuration)

Configure which Dynatrace environment and entities DevOps Agent should monitor.

1. Provide the **Environment ID** of your Dynatrace SaaS environment.
   - Found in your Dynatrace URL: `https://<environment-id>.live.dynatrace.com`
2. Specify **Entity IDs** to scope the integration:
   - Host groups
   - Management zones
   - Specific services or applications
3. Associate the Dynatrace connection with an Agent Space.

### Step 3: Configure Dynatrace Environment

Install and configure the SRE Agents app in your Dynatrace environment.

1. In Dynatrace, go to the **Hub** and install the **SRE Agents** app.
2. Open the SRE Agents app and configure the webhook destination:
   - Webhook URL: Provided in the DevOps Agent console after registration
   - Authentication: HMAC signature verification
3. Configure which problem types should trigger notifications to DevOps Agent.

## Supported Event Schemas

### Incident Events

Dynatrace sends incident events when problems are detected:

```json
{
  "event_type": "incident",
  "source": "dynatrace",
  "problem_id": "P-12345",
  "title": "High CPU on host-001",
  "severity": "CRITICAL",
  "status": "OPEN",
  "impact_level": "SERVICE",
  "affected_entities": [
    {
      "entity_id": "HOST-ABC123",
      "entity_type": "HOST",
      "entity_name": "host-001"
    }
  ],
  "root_cause": {
    "entity_id": "PROCESS_GROUP_INSTANCE-XYZ",
    "entity_type": "PROCESS_GROUP_INSTANCE"
  },
  "start_time": "2024-01-15T10:30:00Z"
}
```

### Mitigation Events

DevOps Agent can send mitigation actions back to Dynatrace:

```json
{
  "event_type": "mitigation",
  "source": "aws_devops_agent",
  "problem_id": "P-12345",
  "action": "scale_up",
  "status": "EXECUTED",
  "details": {
    "resource": "arn:aws:ecs:us-east-1:123456789012:service/my-service",
    "previous_count": 2,
    "new_count": 4
  },
  "timestamp": "2024-01-15T10:35:00Z"
}
```

## Capabilities

With the 2-way Dynatrace integration, DevOps Agent can:

- Receive real-time problem notifications
- Query metrics for affected entities
- Retrieve distributed traces for failing services
- Access log data related to detected problems
- Understand service topology and dependencies
- Correlate Dynatrace problems with AWS resource events
- Report mitigation actions taken back to Dynatrace

## Troubleshooting

- **OAuth errors**: Verify the client ID and secret, and ensure all required scopes are granted.
- **No events received**: Check that the SRE Agents app is installed and the webhook URL is correctly configured.
- **Missing data in queries**: Ensure the entity IDs are correct and the OAuth client has the necessary read scopes.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] How do I connect connecting dynatrace to AWS DevOps Agent?

[Assistant] AWS DevOps Agent supports a 2-way integration with Dynatrace SaaS. This integration allows DevOps Agent to receive incident notifications from Dynatrace and actively query the Dynatrace environment for metrics, traces, logs, and topology data during investigations.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What's the process for integrating connecting dynatrace with AWS DevOps Agent?

[Assistant] AWS DevOps Agent supports a 2-way integration with Dynatrace SaaS. This integration allows DevOps Agent to receive incident notifications from Dynatrace and actively query the Dynatrace environment for metrics, traces, logs, and topology data during investigations.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Prerequisites in AWS DevOps Agent?

[Assistant]
- Dynatrace SaaS environment (not Dynatrace Managed)
- Dynatrace account with admin permissions to create OAuth clients
- AWS DevOps Agent deployed and configured


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Prerequisites in AWS DevOps Agent.

[Assistant]
- Dynatrace SaaS environment (not Dynatrace Managed)
- Dynatrace account with admin permissions to create OAuth clients
- AWS DevOps Agent deployed and configured


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] How do I set up connecting dynatrace in AWS DevOps Agent?

[Assistant]
Create an OAuth client in Dynatrace to allow DevOps Agent to authenticate.

1. In Dynatrace, navigate to **Account Management > Identity & access management > OAuth clients**.
2. Create a new OAuth client with the following scopes:
   - `storage:logs:read`
   - `storage:metrics:read`
   - `storage:events:read`
   - `storage:entities:read`
   - `storage:bizevents:read`
   - `environment-api:metrics:read`
   - `environment-api:entities:read`
   - `environment-api:events:read`
   - `environment-api:problems:read`
   - `environment-api:slo:read`
3. Note the client ID and client secret.
4. In the DevOps Agent console, navigate to **Telemetry Sources > Add > Dynatrace**.
5. Enter the OAuth client ID and client secret.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Walk me through step 1: connect (oauth client setup) for AWS DevOps Agent.

[Assistant]
Create an OAuth client in Dynatrace to allow DevOps Agent to authenticate.

1. In Dynatrace, navigate to **Account Management > Identity & access management > OAuth clients**.
2. Create a new OAuth client with the following scopes:
   - `storage:logs:read`
   - `storage:metrics:read`
   - `storage:events:read`
   - `storage:entities:read`
   - `storage:bizevents:read`
   - `environment-api:metrics:read`
   - `environment-api:entities:read`
   - `environment-api:events:read`
   - `environment-api:problems:read`
   - `environment-api:slo:read`
3. Note the client ID and client secret.
4. In the DevOps Agent console, navigate to **Telemetry Sources > Add > Dynatrace**.
5. Enter the OAuth client ID and client secret.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Step 2: Enable (Environment and Entity Configuration) in AWS DevOps Agent?

[Assistant]
Configure which Dynatrace environment and entities DevOps Agent should monitor.

1. Provide the **Environment ID** of your Dynatrace SaaS environment.
   - Found in your Dynatrace URL: `https://<environment-id>.live.dynatrace.com`
2. Specify **Entity IDs** to scope the integration:
   - Host groups
   - Management zones
   - Specific services or applications
3. Associate the Dynatrace connection with an Agent Space.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Step 2: Enable (Environment and Entity Configuration) in AWS DevOps Agent.

[Assistant]
Configure which Dynatrace environment and entities DevOps Agent should monitor.

1. Provide the **Environment ID** of your Dynatrace SaaS environment.
   - Found in your Dynatrace URL: `https://<environment-id>.live.dynatrace.com`
2. Specify **Entity IDs** to scope the integration:
   - Host groups
   - Management zones
   - Specific services or applications
3. Associate the Dynatrace connection with an Agent Space.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Step 3: Configure Dynatrace Environment in AWS DevOps Agent?

[Assistant]
Install and configure the SRE Agents app in your Dynatrace environment.

1. In Dynatrace, go to the **Hub** and install the **SRE Agents** app.
2. Open the SRE Agents app and configure the webhook destination:
   - Webhook URL: Provided in the DevOps Agent console after registration
   - Authentication: HMAC signature verification
3. Configure which problem types should trigger notifications to DevOps Agent.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Step 3: Configure Dynatrace Environment in AWS DevOps Agent.

[Assistant]
Install and configure the SRE Agents app in your Dynatrace environment.

1. In Dynatrace, go to the **Hub** and install the **SRE Agents** app.
2. Open the SRE Agents app and configure the webhook destination:
   - Webhook URL: Provided in the DevOps Agent console after registration
   - Authentication: HMAC signature verification
3. Configure which problem types should trigger notifications to DevOps Agent.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Incident Events in AWS DevOps Agent?

[Assistant]
Dynatrace sends incident events when problems are detected:

```json
{
  "event_type": "incident",
  "source": "dynatrace",
  "problem_id": "P-12345",
  "title": "High CPU on host-001",
  "severity": "CRITICAL",
  "status": "OPEN",
  "impact_level": "SERVICE",
  "affected_entities": [
    {
      "entity_id": "HOST-ABC123",
      "entity_type": "HOST",
      "entity_name": "host-001"
    }
  ],
  "root_cause": {
    "entity_id": "PROCESS_GROUP_INSTANCE-XYZ",
    "entity_type": "PROCESS_GROUP_INSTANCE"
  },
  "start_time": "2024-01-15T10:30:00Z"
}
```


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Incident Events in AWS DevOps Agent.

[Assistant]
Dynatrace sends incident events when problems are detected:

```json
{
  "event_type": "incident",
  "source": "dynatrace",
  "problem_id": "P-12345",
  "title": "High CPU on host-001",
  "severity": "CRITICAL",
  "status": "OPEN",
  "impact_level": "SERVICE",
  "affected_entities": [
    {
      "entity_id": "HOST-ABC123",
      "entity_type": "HOST",
      "entity_name": "host-001"
    }
  ],
  "root_cause": {
    "entity_id": "PROCESS_GROUP_INSTANCE-XYZ",
    "entity_type": "PROCESS_GROUP_INSTANCE"
  },
  "start_time": "2024-01-15T10:30:00Z"
}
```


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Mitigation Events in AWS DevOps Agent?

[Assistant]
DevOps Agent can send mitigation actions back to Dynatrace:

```json
{
  "event_type": "mitigation",
  "source": "aws_devops_agent",
  "problem_id": "P-12345",
  "action": "scale_up",
  "status": "EXECUTED",
  "details": {
    "resource": "arn:aws:ecs:us-east-1:123456789012:service/my-service",
    "previous_count": 2,
    "new_count": 4
  },
  "timestamp": "2024-01-15T10:35:00Z"
}
```


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Mitigation Events in AWS DevOps Agent.

[Assistant]
DevOps Agent can send mitigation actions back to Dynatrace:

```json
{
  "event_type": "mitigation",
  "source": "aws_devops_agent",
  "problem_id": "P-12345",
  "action": "scale_up",
  "status": "EXECUTED",
  "details": {
    "resource": "arn:aws:ecs:us-east-1:123456789012:service/my-service",
    "previous_count": 2,
    "new_count": 4
  },
  "timestamp": "2024-01-15T10:35:00Z"
}
```


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Capabilities in AWS DevOps Agent?

[Assistant]
With the 2-way Dynatrace integration, DevOps Agent can:

- Receive real-time problem notifications
- Query metrics for affected entities
- Retrieve distributed traces for failing services
- Access log data related to detected problems
- Understand service topology and dependencies
- Correlate Dynatrace problems with AWS resource events
- Report mitigation actions taken back to Dynatrace


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Capabilities in AWS DevOps Agent.

[Assistant]
With the 2-way Dynatrace integration, DevOps Agent can:

- Receive real-time problem notifications
- Query metrics for affected entities
- Retrieve distributed traces for failing services
- Access log data related to detected problems
- Understand service topology and dependencies
- Correlate Dynatrace problems with AWS resource events
- Report mitigation actions taken back to Dynatrace


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Troubleshooting in AWS DevOps Agent?

[Assistant]
- **OAuth errors**: Verify the client ID and secret, and ensure all required scopes are granted.
- **No events received**: Check that the SRE Agents app is installed and the webhook URL is correctly configured.
- **Missing data in queries**: Ensure the entity IDs are correct and the OAuth client has the necessary read scopes.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Troubleshooting in AWS DevOps Agent.

[Assistant]
- **OAuth errors**: Verify the client ID and secret, and ensure all required scopes are granted.
- **No events received**: Check that the SRE Agents app is installed and the webhook URL is correctly configured.
- **Missing data in queries**: Ensure the entity IDs are correct and the OAuth client has the necessary read scopes.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Give me a comprehensive overview of connecting grafana in AWS DevOps Agent.

[Assistant]
# Connecting Grafana

AWS DevOps Agent supports integration with Grafana 9.0 and later. This integration allows DevOps Agent to receive alert notifications from Grafana and query dashboards, datasources, and alert rules during investigations.

## Prerequisites

- Grafana 9.0 or later (self-hosted or Grafana Cloud)
- Grafana service account with appropriate permissions
- AWS DevOps Agent deployed and configured

## Step 1: Register with Service Account Token

Create a Grafana service account and generate a token for DevOps Agent.

1. In Grafana, navigate to **Administration > Service Accounts**.
2. Create a new service account:
   - **Name**: `aws-devops-agent`
   - **Role**: Viewer (minimum required)
3. Generate a token for the service account and note it securely.
4. In the DevOps Agent console, navigate to **Telemetry Sources > Add > Grafana**.
5. Provide:
   - **Grafana URL**: The base URL of your Grafana instance (e.g., `https://grafana.example.com`)
   - **Service Account Token**: The token generated above
6. DevOps Agent will validate the connection and register the MCP endpoint.

## Step 2: Add to Agent Space

Associate the Grafana integration with an Agent Space.

1. Navigate to the Agent Space configuration.
2. Under **Telemetry Sources**, select **Add source**.
3. Choose the registered Grafana integration.
4. Optionally scope to specific folders or dashboards.
5. Save the configuration.

## Step 3: Configure Alert Webhooks

Configure Grafana to send alert notifications to DevOps Agent.

### Create a Contact Point

1. In Grafana, go to **Alerting > Contact points**.
2. Create a new contact point:
   - **Name**: `aws-devops-agent`
   - **Type**: Webhook
   - **URL**: The webhook URL from the DevOps Agent console
   - **HTTP Method**: POST
   - **Authorization Header**: Bearer token or HMAC as configured

### Custom Notification Template

Create a custom notification template for the webhook payload:

1. Go to **Alerting > Notification templates**.
2. Create a new template:

```
{{ define "devops_agent_payload" }}
{
  "event_type": "alert",
  "source": "grafana",
  "alert_name": "{{ .CommonLabels.alertname }}",
  "status": "{{ .Status }}",
  "severity": "{{ .CommonLabels.severity }}",
  "summary": "{{ .CommonAnnotations.summary }}",
  "description": "{{ .CommonAnnotations.description }}",
  "dashboard_url": "{{ .CommonAnnotations.dashboard_url }}",
  "panel_id": "{{ .CommonAnnotations.panel_id }}",
  "values": {{ .Values | toJSON }},
  "labels": {{ .CommonLabels | toJSON }},
  "starts_at": "{{ .StartsAt }}",
  "ends_at": "{{ .EndsAt }}"
}
{{ end }}
```

3. Assign the template to the `aws-devops-agent` contact point.

### Create a Notification Policy

1. Go to **Alerting > Notification policies**.
2. Create a policy that routes relevant alerts to the `aws-devops-agent` contact point.
3. Use label matchers to control which alerts are sent (e.g., `team=platform` or `severity=critical`).

## Capabilities

With the Grafana integration, DevOps Agent can:

- Receive real-time alert notifications
- Query dashboard panels for metric visualizations
- List and inspect alert rules and their states
- Access datasource queries for additional context
- Retrieve annotation data for correlation

## Limitations

### ClickHouse Not Supported

DevOps Agent cannot directly query ClickHouse datasources through the Grafana integration. If your Grafana dashboards use ClickHouse as a backend, the agent can view dashboard panels but cannot execute arbitrary ClickHouse queries.

### Amazon Managed Grafana Webhook Limitations

When using Amazon Managed Grafana:

- Webhooks must be configured through the AWS-managed alert notification channels.
- Some self-hosted Grafana webhook features may not be available.
- Ensure the Managed Grafana workspace has outbound network access to the DevOps Agent webhook endpoint.
- VPC endpoint configuration may be required for private connectivity.

## Troubleshooting

- **Authentication errors**: Verify the service account token is valid and has Viewer role.
- **Connection timeout**: Ensure the Grafana URL is reachable from DevOps Agent. Use a private connection if Grafana is not publicly accessible.
- **Missing dashboards**: Check that the service account has access to the folders containing the dashboards.
- **Webhooks not received**: Verify the notification policy routes alerts to the correct contact point.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is connecting grafana?

[Assistant]
# Connecting Grafana

AWS DevOps Agent supports integration with Grafana 9.0 and later. This integration allows DevOps Agent to receive alert notifications from Grafana and query dashboards, datasources, and alert rules during investigations.

## Prerequisites

- Grafana 9.0 or later (self-hosted or Grafana Cloud)
- Grafana service account with appropriate permissions
- AWS DevOps Agent deployed and configured

## Step 1: Register with Service Account Token

Create a Grafana service account and generate a token for DevOps Agent.

1. In Grafana, navigate to **Administration > Service Accounts**.
2. Create a new service account:
   - **Name**: `aws-devops-agent`
   - **Role**: Viewer (minimum required)
3. Generate a token for the service account and note it securely.
4. In the DevOps Agent console, navigate to **Telemetry Sources > Add > Grafana**.
5. Provide:
   - **Grafana URL**: The base URL of your Grafana instance (e.g., `https://grafana.example.com`)
   - **Service Account Token**: The token generated above
6. DevOps Agent will validate the connection and register the MCP endpoint.

## Step 2: Add to Agent Space

Associate the Grafana integration with an Agent Space.

1. Navigate to the Agent Space configuration.
2. Under **Telemetry Sources**, select **Add source**.
3. Choose the registered Grafana integration.
4. Optionally scope to specific folders or dashboards.
5. Save the configuration.

## Step 3: Configure Alert Webhooks

Configure Grafana to send alert notifications to DevOps Agent.

### Create a Contact Point

1. In Grafana, go to **Alerting > Contact points**.
2. Create a new contact point:
   - **Name**: `aws-devops-agent`
   - **Type**: Webhook
   - **URL**: The webhook URL from the DevOps Agent console
   - **HTTP Method**: POST
   - **Authorization Header**: Bearer token or HMAC as configured

### Custom Notification Template

Create a custom notification template for the webhook payload:

1. Go to **Alerting > Notification templates**.
2. Create a new template:

```
{{ define "devops_agent_payload" }}
{
  "event_type": "alert",
  "source": "grafana",
  "alert_name": "{{ .CommonLabels.alertname }}",
  "status": "{{ .Status }}",
  "severity": "{{ .CommonLabels.severity }}",
  "summary": "{{ .CommonAnnotations.summary }}",
  "description": "{{ .CommonAnnotations.description }}",
  "dashboard_url": "{{ .CommonAnnotations.dashboard_url }}",
  "panel_id": "{{ .CommonAnnotations.panel_id }}",
  "values": {{ .Values | toJSON }},
  "labels": {{ .CommonLabels | toJSON }},
  "starts_at": "{{ .StartsAt }}",
  "ends_at": "{{ .EndsAt }}"
}
{{ end }}
```

3. Assign the template to the `aws-devops-agent` contact point.

### Create a Notification Policy

1. Go to **Alerting > Notification policies**.
2. Create a policy that routes relevant alerts to the `aws-devops-agent` contact point.
3. Use label matchers to control which alerts are sent (e.g., `team=platform` or `severity=critical`).

## Capabilities

With the Grafana integration, DevOps Agent can:

- Receive real-time alert notifications
- Query dashboard panels for metric visualizations
- List and inspect alert rules and their states
- Access datasource queries for additional context
- Retrieve annotation data for correlation

## Limitations

### ClickHouse Not Supported

DevOps Agent cannot directly query ClickHouse datasources through the Grafana integration. If your Grafana dashboards use ClickHouse as a backend, the agent can view dashboard panels but cannot execute arbitrary ClickHouse queries.

### Amazon Managed Grafana Webhook Limitations

When using Amazon Managed Grafana:

- Webhooks must be configured through the AWS-managed alert notification channels.
- Some self-hosted Grafana webhook features may not be available.
- Ensure the Managed Grafana workspace has outbound network access to the DevOps Agent webhook endpoint.
- VPC endpoint configuration may be required for private connectivity.

## Troubleshooting

- **Authentication errors**: Verify the service account token is valid and has Viewer role.
- **Connection timeout**: Ensure the Grafana URL is reachable from DevOps Agent. Use a private connection if Grafana is not publicly accessible.
- **Missing dashboards**: Check that the service account has access to the folders containing the dashboards.
- **Webhooks not received**: Verify the notification policy routes alerts to the correct contact point.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] How do I connect connecting grafana to AWS DevOps Agent?

[Assistant] AWS DevOps Agent supports integration with Grafana 9.0 and later. This integration allows DevOps Agent to receive alert notifications from Grafana and query dashboards, datasources, and alert rules during investigations.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What's the process for integrating connecting grafana with AWS DevOps Agent?

[Assistant] AWS DevOps Agent supports integration with Grafana 9.0 and later. This integration allows DevOps Agent to receive alert notifications from Grafana and query dashboards, datasources, and alert rules during investigations.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Prerequisites in AWS DevOps Agent?

[Assistant]
- Grafana 9.0 or later (self-hosted or Grafana Cloud)
- Grafana service account with appropriate permissions
- AWS DevOps Agent deployed and configured


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Prerequisites in AWS DevOps Agent.

[Assistant]
- Grafana 9.0 or later (self-hosted or Grafana Cloud)
- Grafana service account with appropriate permissions
- AWS DevOps Agent deployed and configured


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Step 1: Register with Service Account Token in AWS DevOps Agent?

[Assistant]
Create a Grafana service account and generate a token for DevOps Agent.

1. In Grafana, navigate to **Administration > Service Accounts**.
2. Create a new service account:
   - **Name**: `aws-devops-agent`
   - **Role**: Viewer (minimum required)
3. Generate a token for the service account and note it securely.
4. In the DevOps Agent console, navigate to **Telemetry Sources > Add > Grafana**.
5. Provide:
   - **Grafana URL**: The base URL of your Grafana instance (e.g., `https://grafana.example.com`)
   - **Service Account Token**: The token generated above
6. DevOps Agent will validate the connection and register the MCP endpoint.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Step 1: Register with Service Account Token in AWS DevOps Agent.

[Assistant]
Create a Grafana service account and generate a token for DevOps Agent.

1. In Grafana, navigate to **Administration > Service Accounts**.
2. Create a new service account:
   - **Name**: `aws-devops-agent`
   - **Role**: Viewer (minimum required)
3. Generate a token for the service account and note it securely.
4. In the DevOps Agent console, navigate to **Telemetry Sources > Add > Grafana**.
5. Provide:
   - **Grafana URL**: The base URL of your Grafana instance (e.g., `https://grafana.example.com`)
   - **Service Account Token**: The token generated above
6. DevOps Agent will validate the connection and register the MCP endpoint.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Step 2: Add to Agent Space in AWS DevOps Agent?

[Assistant]
Associate the Grafana integration with an Agent Space.

1. Navigate to the Agent Space configuration.
2. Under **Telemetry Sources**, select **Add source**.
3. Choose the registered Grafana integration.
4. Optionally scope to specific folders or dashboards.
5. Save the configuration.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Step 2: Add to Agent Space in AWS DevOps Agent.

[Assistant]
Associate the Grafana integration with an Agent Space.

1. Navigate to the Agent Space configuration.
2. Under **Telemetry Sources**, select **Add source**.
3. Choose the registered Grafana integration.
4. Optionally scope to specific folders or dashboards.
5. Save the configuration.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Step 3: Configure Alert Webhooks in AWS DevOps Agent?

[Assistant] Configure Grafana to send alert notifications to DevOps Agent.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Step 3: Configure Alert Webhooks in AWS DevOps Agent.

[Assistant] Configure Grafana to send alert notifications to DevOps Agent.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Create a Contact Point in AWS DevOps Agent?

[Assistant]
1. In Grafana, go to **Alerting > Contact points**.
2. Create a new contact point:
   - **Name**: `aws-devops-agent`
   - **Type**: Webhook
   - **URL**: The webhook URL from the DevOps Agent console
   - **HTTP Method**: POST
   - **Authorization Header**: Bearer token or HMAC as configured


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Create a Contact Point in AWS DevOps Agent.

[Assistant]
1. In Grafana, go to **Alerting > Contact points**.
2. Create a new contact point:
   - **Name**: `aws-devops-agent`
   - **Type**: Webhook
   - **URL**: The webhook URL from the DevOps Agent console
   - **HTTP Method**: POST
   - **Authorization Header**: Bearer token or HMAC as configured


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Custom Notification Template in AWS DevOps Agent?

[Assistant]
Create a custom notification template for the webhook payload:

1. Go to **Alerting > Notification templates**.
2. Create a new template:

```
{{ define "devops_agent_payload" }}
{
  "event_type": "alert",
  "source": "grafana",
  "alert_name": "{{ .CommonLabels.alertname }}",
  "status": "{{ .Status }}",
  "severity": "{{ .CommonLabels.severity }}",
  "summary": "{{ .CommonAnnotations.summary }}",
  "description": "{{ .CommonAnnotations.description }}",
  "dashboard_url": "{{ .CommonAnnotations.dashboard_url }}",
  "panel_id": "{{ .CommonAnnotations.panel_id }}",
  "values": {{ .Values | toJSON }},
  "labels": {{ .CommonLabels | toJSON }},
  "starts_at": "{{ .StartsAt }}",
  "ends_at": "{{ .EndsAt }}"
}
{{ end }}
```

3. Assign the template to the `aws-devops-agent` contact point.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Custom Notification Template in AWS DevOps Agent.

[Assistant]
Create a custom notification template for the webhook payload:

1. Go to **Alerting > Notification templates**.
2. Create a new template:

```
{{ define "devops_agent_payload" }}
{
  "event_type": "alert",
  "source": "grafana",
  "alert_name": "{{ .CommonLabels.alertname }}",
  "status": "{{ .Status }}",
  "severity": "{{ .CommonLabels.severity }}",
  "summary": "{{ .CommonAnnotations.summary }}",
  "description": "{{ .CommonAnnotations.description }}",
  "dashboard_url": "{{ .CommonAnnotations.dashboard_url }}",
  "panel_id": "{{ .CommonAnnotations.panel_id }}",
  "values": {{ .Values | toJSON }},
  "labels": {{ .CommonLabels | toJSON }},
  "starts_at": "{{ .StartsAt }}",
  "ends_at": "{{ .EndsAt }}"
}
{{ end }}
```

3. Assign the template to the `aws-devops-agent` contact point.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Create a Notification Policy in AWS DevOps Agent?

[Assistant]
1. Go to **Alerting > Notification policies**.
2. Create a policy that routes relevant alerts to the `aws-devops-agent` contact point.
3. Use label matchers to control which alerts are sent (e.g., `team=platform` or `severity=critical`).


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Create a Notification Policy in AWS DevOps Agent.

[Assistant]
1. Go to **Alerting > Notification policies**.
2. Create a policy that routes relevant alerts to the `aws-devops-agent` contact point.
3. Use label matchers to control which alerts are sent (e.g., `team=platform` or `severity=critical`).


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Capabilities in AWS DevOps Agent?

[Assistant]
With the Grafana integration, DevOps Agent can:

- Receive real-time alert notifications
- Query dashboard panels for metric visualizations
- List and inspect alert rules and their states
- Access datasource queries for additional context
- Retrieve annotation data for correlation


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Capabilities in AWS DevOps Agent.

[Assistant]
With the Grafana integration, DevOps Agent can:

- Receive real-time alert notifications
- Query dashboard panels for metric visualizations
- List and inspect alert rules and their states
- Access datasource queries for additional context
- Retrieve annotation data for correlation


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is ClickHouse Not Supported in AWS DevOps Agent?

[Assistant] DevOps Agent cannot directly query ClickHouse datasources through the Grafana integration. If your Grafana dashboards use ClickHouse as a backend, the agent can view dashboard panels but cannot execute arbitrary ClickHouse queries.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about ClickHouse Not Supported in AWS DevOps Agent.

[Assistant] DevOps Agent cannot directly query ClickHouse datasources through the Grafana integration. If your Grafana dashboards use ClickHouse as a backend, the agent can view dashboard panels but cannot execute arbitrary ClickHouse queries.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Amazon Managed Grafana Webhook Limitations in AWS DevOps Agent?

[Assistant]
When using Amazon Managed Grafana:

- Webhooks must be configured through the AWS-managed alert notification channels.
- Some self-hosted Grafana webhook features may not be available.
- Ensure the Managed Grafana workspace has outbound network access to the DevOps Agent webhook endpoint.
- VPC endpoint configuration may be required for private connectivity.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Amazon Managed Grafana Webhook Limitations in AWS DevOps Agent.

[Assistant]
When using Amazon Managed Grafana:

- Webhooks must be configured through the AWS-managed alert notification channels.
- Some self-hosted Grafana webhook features may not be available.
- Ensure the Managed Grafana workspace has outbound network access to the DevOps Agent webhook endpoint.
- VPC endpoint configuration may be required for private connectivity.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] What is Troubleshooting in AWS DevOps Agent?

[Assistant]
- **Authentication errors**: Verify the service account token is valid and has Viewer role.
- **Connection timeout**: Ensure the Grafana URL is reachable from DevOps Agent. Use a private connection if Grafana is not publicly accessible.
- **Missing dashboards**: Check that the service account has access to the folders containing the dashboards.
- **Webhooks not received**: Verify the notification policy routes alerts to the correct contact point.


[System]
/no_think
You are Tech Advisor, an expert on AWS cloud services with deep knowledge of AWS DevOps Agent.

You have comprehensive knowledge of AWS DevOps Agent including:
- What it is and how it works (Agent Spaces, topology, dual-console architecture)
- Key features: autonomous incident response, proactive prevention, on-demand SRE tasks
- Integrations: CloudWatch, Datadog, Dynatrace, New Relic, Splunk, Grafana, PagerDuty, GitHub, GitLab, Azure DevOps, ServiceNow, Slack
- GA features: Azure/on-prem support, Triage Agent, Learned/Custom Skills, Code Indexing, Private Connections
- Pricing: $0.0083 per agent-second, free trial details, AWS Support credits
- Getting started: Agent Spaces, connecting tools, running investigations
- Security: encryption, customer managed keys, IdP integration, CloudTrail auditing
- Available regions: US East, US West, Frankfurt, Ireland, Sydney, Tokyo

Be concise and structured. Use bullet points where appropriate. Provide accurate, detailed answers.

[User] Tell me about Troubleshooting in AWS DevOps Agent.

[Assistant]
- **Authentication errors**: Verify the service account token is valid and has Viewer role.
- **Connection timeout**: Ensure the Grafana URL is reachable from DevOps Agent. Use a private connection if Grafana is not publicly accessible.
- **Missing dashboards**: Check that the service account has access to the folders containing the dashboards.
- **Webhooks not received**: Verify the notification policy routes alerts to the correct contact point.