File size: 5,734 Bytes
7190f61
 
 
 
 
 
edbfd50
7190f61
 
 
 
d50e95a
 
 
d1e17cd
d50e95a
5170a16
93772e5
 
 
 
 
 
 
 
 
 
 
2cd6427
d50e95a
93772e5
2cd6427
d50e95a
a4629c9
93772e5
 
 
 
 
 
b789a47
bb78df3
d1e17cd
 
 
a4629c9
2cd6427
93772e5
 
 
 
 
2cd6427
93772e5
 
 
2cd6427
61ca658
 
 
 
 
 
 
17183d1
61ca658
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d1e17cd
85cbfe8
3bd7852
85cbfe8
3bd7852
a4629c9
 
d1e17cd
 
85cbfe8
d1e17cd
85cbfe8
5170a16
 
 
 
 
 
 
85cbfe8
5170a16
a8dd69e
85cbfe8
 
 
 
 
ef62c1c
93772e5
ef62c1c
d1e17cd
 
85cbfe8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b789a47
85cbfe8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
a4629c9
d1e17cd
a8dd69e
 
 
 
a4629c9
d1e17cd
 
5170a16
 
d393666
5170a16
d393666
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
---
title: NexDatawork Mini Agent
emoji: 🤖
colorFrom: indigo
colorTo: purple
sdk: gradio
app_file: examples/app.py
pinned: false
---


<p align="center">
  <img src="assets/banner.png" alt="NexDatawork Banner" width="100%"/>
</p>

<div align="center">



<h1 style="margin-bottom:0; border-bottom:none;">
  <a
    href="https://www.nexdatawork.io/blank"
    style="color:#5A2AB8; text-decoration:none;"
  >
    NexDatawork
  </a>
</h1>


 <h2 style="margin-top:0;">
  Building the Data Infrastructure for AI  
 </h2>

 <div align='center'>
 <a href="https://github.com/NexDatawork/data-agents/pulls"><img alt = "pull requests" src = "https://img.shields.io/github/issues-pr-closed/NexDatawork/data-agents?label=pull%20requests&labelColor=3834B6&color=5A2AB8"/></a> 
<a href="https://github.com/NexDatawork/data-agents/blob/main/LICENSE"><img alt="LICENSE" src="https://img.shields.io/badge/license-Apache%202.0-blueviolet?style=flat&labelColor=3834B6&color=5A2AB8"/></a>
<a href="https://www.nexdatawork.io" target="_blank"><img alt="Website" src="https://img.shields.io/badge/Website-nexdatawork.io-5A2AB8?style=flat&labelColor=3834B6"/></a>
<a href="https://discord.gg/Tb55tT5UtZ"><img src="https://img.shields.io/badge/Discord-Join%20Community-7289DA?logo=discord&logoColor=white&labelColor=3834B6&color=5A2AB8" alt="Discord"/></a>
<a href="https://github.com/NexDatawork/data-agents/stargazers"><img src="https://img.shields.io/github/stars/NexDatawork/data-agents?style=social" alt="GitHub Stars"></a>
<a href="https://huggingface.co/NexDatawork">
  <img alt="Hugging Face" src="https://img.shields.io/badge/Hugging%20Face-Models%20%26%20Datasets?logo=huggingface&labelColor=3834B6&color=5A2AB8">
</a>


 </div>

</div>
An open-source, no-code agentic AI for building and evolving data layers for AI/ML. The open source repo includes a playground and sandbox environment for testing, experimentation, and community contributions.

## About

[NexDatawork](https://www.nexdatawork.io) builds a no-code, agentic AI that creates, maintains, and evolves the data layer required for AI/ML adoption.

It supports multiple data engineering and analytics workflows, including **multi-source data extraction**, **schema inference & metadata capture**, **query creation**, and **automated feature engineering**. 

The open source project includes a Hugging Face playground as a sandbox environment where users can experiment with the data agent, and a notebook for contributors to validate use cases and contribute improvements through pull requests.

## Trying out the Demo on Hugging Face

You can test the NexDatawork data agent directly in the Hugging Face sandbox without any local setup requirment. You can:
- Upload CSV, or JSON files
- Ask questions about your uploaded dataset
- View the explainable agent's reasoning and ETL steps

> Important Note: The Hugging Face demo is intended purely for experimentation, testing and demonstration purposes only, and is not reflective of the final product's full capabilities and features.


## Run the Notebook

To understand how the data agent works step by step, you can run the Jupyter notebook included in this repository, in which each cell shows respective reasoning and outputs, and is primarily helpful for debugging the agent logic.


## Contributing via the Notebook

Contributors are welcome to:
- Improve the agent's various prompts
- Add new helpful tools (such as ETL, SQL, or web enrichments)
- Experiment with the UI or implement certain workflow changes

Note: You can attempt to submit adequate changes by opening a pull request.


## Table of contents
 * [Features & Workflow ](#features--workflow)
 * [Architecture](#architecture)
 * [Use Case](#use-case)
 * [Requirements & Starting Procedures](#requirements--starting-procedures)
 * [License](#license)
 * [Contributing](#contributing)


## <a name='features--workflow'></a>Features & Workflow

### Features

 - Display of reasoning
 - Simple Dashboard and Export
 - Seamless workflow set-up
 - Contextual intelligence
 - Chat-bot for refining the results

### Workflow




## <a name='architecture'></a>Architecture



## <a name='use-case'></a>Use Case




### Requirenments
 * [Node.js](https://nodejs.org/en)
 
 In order to run the programme Supabase and OpenAI API keys are needed.
 
 * [Supabase](https://supabase.com/)
 * [OpenAI](https://platform.openai.com/docs/overview)


### Environment Variables

To run this project, you will need to add the following environment variables to your [.env](.env.example) file

`NEXT_PUBLIC_SUPABASE_URL`

`NEXT_PUBLIC_SUPABASE_ANON_KEY`

`OPENAI_API_KEY`

### Quickstart

In order to start working with the program run the following code:
```bash
git clone https://github.com/NexDatawork/data-agents.git
cd data-agents
cp .env.example .env

Fill the URL and APIs in the environment file as shown in the [.env.example](.env.example).

When starting the program for the first time, run this code in your command line:

```bash
npm install
```

Afterwards the programme can be started as follows:
```bash
npm run dev
```



## <a name='contributing'></a>Contributing

Contributions are always welcome!

See [CONTRIBUTING.md](CONTRIBUTING.md) for ways to get started.

## <a name='license'></a>License

This project is licensed under [the Apache-2.0 license](LICENSE).


## How to Try and Contribute

### Try the App
Users can test the application directly in the Hugging Face sandbox without any local setup. 

### Run the Notebooks
The project includes Jupyter notebooks that allow users to run the code step by step and observe results line by line. 

### Contribute to the Project
Contributors are welcome to improve the project by modifying existing notebook files.