File size: 4,601 Bytes
2cf28e4
 
 
 
 
 
 
280e937
2cf28e4
 
 
 
892c4a4
6da940d
1fd3122
6da940d
892c4a4
 
1b04ac5
892c4a4
 
 
 
 
 
1b04ac5
892c4a4
 
 
 
 
fd91642
 
 
 
 
892c4a4
 
 
fd91642
892c4a4
 
 
fd91642
892c4a4
 
 
 
 
fd91642
892c4a4
 
 
fd91642
2e49af5
 
 
 
 
 
e7fad91
2e49af5
e7fad91
2e49af5
e7fad91
2e49af5
 
 
892c4a4
 
 
 
 
 
 
 
 
 
fd91642
 
 
 
 
892c4a4
 
 
fd91642
892c4a4
 
 
fd91642
892c4a4
 
 
fd91642
892c4a4
 
 
dc1a0b8
2e49af5
 
 
dc1a0b8
 
 
 
 
 
 
 
 
 
 
 
 
892c4a4
739ab68
892c4a4
2e49af5
 
892c4a4
6da940d
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
---
title: YDC_AIGOV
sdk: gradio
emoji: 📚
colorFrom: blue
colorTo: yellow
short_description: AI Gov Agents to Improve Shadow AI
sdk_version: 5.20.0
---

---

## Overview of the YDC_AIGOV Platform

The YDC_AIGOV platform employs multiple AI agents to support Shadow AI Governance of applications with embedded AI.

### Problem We Are Trying to Solve

The primary challenge tackled by YDC_AIGOV is a lack of transparency and accessibility in AI policies associated with various applications. Key issues include:

- Difficulty in Locating AI Policy URLs: Users often struggle to find the privacy policies relevant to the applications they use (AI policies are often embedded with company privacy policies).
- Understanding AI Model Integrations: Many users are unaware if the applications they engage with contain embedded AI models and if their data is utilized in training these models.
- Clarifying Opt-Out Options: There is often confusion regarding whether users have the option to opt-out of having their data used for AI training purposes.
- Streamlining Compliance: Organizations face challenges in ensuring compliance with data governance regulations due to the complex nature of policy trails. 

The YDC_AIGOV agents streamlines this process, making it easier for both users and organizations to navigate and understand the policies surrounding AI technologies.

### Agent Architecture

Agents used are as below :

1. **Fuzzy Matching Agent**

   Transforms the entered application name into the correct app name by correcting spelling errors, removing special characters, and addressing other inconsistencies.

2. **Embedded AI Detector Agent**

   Search the internet and fetch relevant data to determine if the application uses AI.

3. **Policy Finder Agent**

   AI Agent from CrewAI to find the privacy policy URL.

4. **Policy Analyzer Agent**

   Provides answers to the following questions:
     - Is user data used for AI/ML training?
     - Is there an opt-out option for AI/ML training?

5. **Policy Decision Agent**

    Makes final determinations on AI policies based on extracted insights from privacy policy text.

6. **Risk Classifier Agent**

   Classifies an input applications as High risk, others and prohibited along with its rationale.

### The processed data is then sent to AI governance platforms like Collibra and ServiceNow, where further workflows are executed.

   Agents used for Creating application, AI Use Case and Assessments are as follow - 
   - **A. createApp_Agent:** Applications are created in platforms based on the CSV input using REST API.

   - **B. createAIUseCases_Agent:** If embedded AI is “Yes,” the corresponding AI use cases are auto-created. 
   
   - **C. conductAIRiskAssessment_Agent:** Risk assessments are performed automatically for AI use cases, particularly if Embedded AI is “Yes” and Data specifically excluded from
   AI training is “No” 


### Risks

**Hallucinations:** AI agents might generate incorrect or fabricated information when the required data is not available or poorly structured.

**Incomplete Data:** Web scraping might miss or misinterpret content due to website restrictions or dynamic loading.

**Bias and Misclassification:** AI may misclassify the presence of opt-out options or embedded AI due to ambiguous language.

#### Agent-Specific Risks:

1. **Fuzzy Matching Agent**

   Incorrect or incomplete app name matches due to imperfect algorithms and variations in spelling or formatting.

2. **Embedded AI Detector Agent**

   Fetches irrelevant or outdated information.

3. **Policy Finder Agent**

   Fails to find or retrieve incorrect URLs.

4. **Policy Analyzer**

   Misinterprets policy text due to ambiguous language.

5. **Policy Decision Agent**

   Hallucinates answers when information is incomplete or ambiguous.

6. **EU AI Act Classifier Agent**

   Often targets specific keywords from the description, which may give incorrect responses in some cases.

7. **Risk Dimension Agent**

   Fails to determine the correct risk dimension, leading to misclassified assessments.

8. **Risk Dimension AI UseCase Agent**

  Retrieves outdated or misinterpreted AI risk and Responsible AI policy data.

9. **Risk Dimension AI Vendor Agent**

   Extracts biased, incomplete, or misleading vendor-related AI risk information.


### Accuracy Metrics
![accuracy_metrics](./Accuracy_Metrics.jpg)

Check out detailed [blog](https://yourdataconnect.com/blogs/ydc_aigov-shadow-ai-governance-agents/) for in-depth information

--- 
You can learn more about us [here](https://yourdataconnect.com/).