Final sync: Ensure all intelligence and formatting fixes are pushed

backup_2026-05-04/.env.example

@@ -0,0 +1,15 @@
+LLM_PROVIDER=groq
+GROQ_API_KEY=your_groq_api_key
+GROQ_MODEL=llama-3.1-8b-instant
+HF_API_KEY=your_huggingface_api_key
+HF_MODEL=meta-llama/Llama-3.1-8B-Instruct
+EMBEDDING_MODEL=BAAI/bge-small-en-v1.5
+DOCS_DIR=docs
+INDEX_DIR=data/index
+SESSIONS_DIR=data/sessions
+TOP_K=4
+CORS_ALLOW_ORIGINS=*
+API_KEY=
+RATE_LIMIT_REQUESTS=60
+RATE_LIMIT_WINDOW_SECONDS=60
+RAG_API_URL=

backup_2026-05-04/.gitattributes

@@ -0,0 +1,2 @@
+*.lottie filter=lfs diff=lfs merge=lfs -text
+*.pdf filter=lfs diff=lfs merge=lfs -text

backup_2026-05-04/.gitignore

@@ -0,0 +1,9 @@
+.env
+__pycache__/
+.pytest_cache/
+.mypy_cache/
+.venv/
+venv/
+# Ignoring data directory to prevent pushing binary index files
+data/index/
+data/sessions/

backup_2026-05-04/CONFIG_NOTES.md

@@ -0,0 +1,38 @@
+# Configuration Backup - Martechsol RAG Chatbot
+**Date:** 2026-04-28
+**Source:** C:\Users\DELL\Desktop\RAG_backup2
+**Destination:** D:\RAG_Backup_2026_04_28
+
+## Core Settings (from app/core/config.py)
+- **App Name:** Fast RAG Chatbot
+- **LLM Provider:** groq (default)
+- **Groq Model:** llama-3.1-8b-instant
+- **HF Model:** meta-llama/Llama-3.1-8B-Instruct
+- **Embedding Model:** BAAI/bge-small-en-v1.5
+- **Docs Directory:** docs/
+- **Index Directory:** data/index/
+- **Sessions Directory:** data/sessions/
+- **Chunk Size:** 420 tokens
+- **Overlap:** 80 tokens
+- **Top K:** 4
+
+## Admin Credentials
+- **Username:** martech_admin
+- **Password:** martech_admin_303
+- **OTP Expiry:** 300 seconds (5 minutes)
+
+## Security
+- **Auth Method:** HTTP Basic Auth + OTP (email-based)
+- **Email for OTP:** randomjoedown@gmail.com
+- **SMTP Server:** smtp.gmail.com (Port 465)
+
+## API / Integration
+- **Endpoint:** /api/chat
+- **Widget Endpoint:** /widget
+- **Admin Endpoint:** /admin
+- **CORS:** Allowed for all (*) for testing
+
+## Infrastructure
+- **Hugging Face Path:** /data (for persistent storage)
+- **Local Path:** data/ (for local storage)
+- **Dockerfile:** Based on python:3.10-slim, serves on port 7860

backup_2026-05-04/CUSTOMIZATION_GUIDE.md

@@ -0,0 +1,55 @@
+# Martechsol Assistant Customization Guide
+
+This guide explains how to customize the visual appearance and behavior of your Gradio-based chat interface.
+
+## 1. Modifying the UI Layout (app/ui_gradio.py)
+
+The interface is built using `gradio.Blocks`. You can modify the structure in the `with gr.Blocks(...) as demo:` section.
+
+### Common Components:
+- **`chatbot`**: The main chat window. We use `elem_id="chatbot-window"` for CSS targeting.
+- **`msg`**: The text input box.
+- **`send`**: The primary action button.
+
+## 2. Custom CSS (app/ui_gradio.py)
+
+At the top of `app/ui_gradio.py`, there is a `custom_css` string. This is the most powerful way to change the look of your app.
+
+### How to target elements:
+We use `elem_id` in Python to give elements stable names. 
+
+Example:
+```python
+chatbot = gr.Chatbot(elem_id="my-custom-chat")
+```
+Then in CSS:
+```css
+#my-custom-chat {
+    background-color: #f0f0f0;
+}
+```
+
+### Important Selectors:
+- **`footer`**: Targets the Gradio branding at the bottom.
+- **`.gradio-container`**: The main outer wrapper of your app.
+- **`[data-testid="user"]`**: Targets user messages.
+- **`[data-testid="bot"]`**: Targets assistant messages.
+
+## 3. Persistent Data on Hugging Face
+
+Your data is stored in the `/data` volume.
+- **Sessions**: `/data/sessions/`
+- **FAISS Index**: `/data/index/`
+
+To manage these, you can use the **Admin Panel** at `/admin`.
+
+## 4. Tips for Widget Embedding
+
+If you are embedding this as an iframe (like in `addon.html`):
+1. **Remove redundant headers**: We hide the Markdown titles in the CSS (`#title-area { display: none; }`) so the iframe looks like a part of your page.
+2. **Handle height**: We set `height: auto !important` and `min-height: 40px !important` on the chatbot so it doesn't take up 500px by default.
+3. **Transparent Background**: You can add `body { background-color: transparent !important; }` to the `custom_css` if your theme supports it.
+
+## 5. Deployment
+
+Whenever you save a file, the changes are automatically pushed to your Hugging Face Space. The Space will rebuild automatically (takes about 1-2 minutes).

backup_2026-05-04/Dockerfile

@@ -0,0 +1,31 @@
+FROM python:3.11-slim
+
+# Set environment variables
+ENV PYTHONDONTWRITEBYTECODE=1
+ENV PYTHONUNBUFFERED=1
+ENV HOME=/home/user
+
+# Create a non-root user for Hugging Face
+RUN useradd -m -u 1000 user
+WORKDIR $HOME/app
+
+# Pre-create data directories with correct ownership
+RUN mkdir -p $HOME/app/data/index $HOME/app/data/sessions && \
+    chown -R user:user $HOME/app
+
+# Switch to non-root user
+USER user
+ENV PATH=$HOME/.local/bin:$PATH
+
+# Install dependencies
+COPY --chown=user requirements.txt .
+RUN pip install --no-cache-dir --user -r requirements.txt
+
+# Copy application code
+COPY --chown=user . .
+
+# Expose port
+EXPOSE 7860
+
+# Start application
+CMD ["python", "-m", "uvicorn", "app.main:app", "--host", "0.0.0.0", "--port", "7860", "--workers", "1"]

backup_2026-05-04/PHPMailer/Exception.php

@@ -0,0 +1,40 @@
+<?php
+
+/**
+ * PHPMailer Exception class.
+ * PHP Version 5.5.
+ *
+ * @see       https://github.com/PHPMailer/PHPMailer/ The PHPMailer GitHub project
+ *
+ * @author    Marcus Bointon (Synchro/coolbru) <phpmailer@synchromedia.co.uk>
+ * @author    Jim Jagielski (jimjag) <jimjag@gmail.com>
+ * @author    Andy Prevost (codeworxtech) <codeworxtech@users.sourceforge.net>
+ * @author    Brent R. Matzelle (original founder)
+ * @copyright 2012 - 2020 Marcus Bointon
+ * @copyright 2010 - 2012 Jim Jagielski
+ * @copyright 2004 - 2009 Andy Prevost
+ * @license   https://www.gnu.org/licenses/old-licenses/lgpl-2.1.html GNU Lesser General Public License
+ * @note      This program is distributed in the hope that it will be useful - WITHOUT
+ * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
+ * FITNESS FOR A PARTICULAR PURPOSE.
+ */
+
+namespace PHPMailer\PHPMailer;
+
+/**
+ * PHPMailer exception handler.
+ *
+ * @author Marcus Bointon <phpmailer@synchromedia.co.uk>
+ */
+class Exception extends \Exception
+{
+    /**
+     * Prettify error message output.
+     *
+     * @return string
+     */
+    public function errorMessage()
+    {
+        return '<strong>' . htmlspecialchars($this->getMessage(), ENT_COMPAT | ENT_HTML401) . "</strong><br />\n";
+    }
+}

backup_2026-05-04/PHPMailer/SMTP.php

@@ -0,0 +1,1509 @@
+<?php
+
+/**
+ * PHPMailer RFC821 SMTP email transport class.
+ * PHP Version 5.5.
+ *
+ * @see       https://github.com/PHPMailer/PHPMailer/ The PHPMailer GitHub project
+ *
+ * @author    Marcus Bointon (Synchro/coolbru) <phpmailer@synchromedia.co.uk>
+ * @author    Jim Jagielski (jimjag) <jimjag@gmail.com>
+ * @author    Andy Prevost (codeworxtech) <codeworxtech@users.sourceforge.net>
+ * @author    Brent R. Matzelle (original founder)
+ * @copyright 2012 - 2020 Marcus Bointon
+ * @copyright 2010 - 2012 Jim Jagielski
+ * @copyright 2004 - 2009 Andy Prevost
+ * @license   https://www.gnu.org/licenses/old-licenses/lgpl-2.1.html GNU Lesser General Public License
+ * @note      This program is distributed in the hope that it will be useful - WITHOUT
+ * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
+ * FITNESS FOR A PARTICULAR PURPOSE.
+ */
+
+namespace PHPMailer\PHPMailer;
+
+/**
+ * PHPMailer RFC821 SMTP email transport class.
+ * Implements RFC 821 SMTP commands and provides some utility methods for sending mail to an SMTP server.
+ *
+ * @author Chris Ryan
+ * @author Marcus Bointon <phpmailer@synchromedia.co.uk>
+ */
+class SMTP
+{
+    /**
+     * The PHPMailer SMTP version number.
+     *
+     * @var string
+     */
+    const VERSION = '6.9.3';
+
+    /**
+     * SMTP line break constant.
+     *
+     * @var string
+     */
+    const LE = "\r\n";
+
+    /**
+     * The SMTP port to use if one is not specified.
+     *
+     * @var int
+     */
+    const DEFAULT_PORT = 25;
+
+    /**
+     * The SMTPs port to use if one is not specified.
+     *
+     * @var int
+     */
+    const DEFAULT_SECURE_PORT = 465;
+
+    /**
+     * The maximum line length allowed by RFC 5321 section 4.5.3.1.6,
+     * *excluding* a trailing CRLF break.
+     *
+     * @see https://www.rfc-editor.org/rfc/rfc5321#section-4.5.3.1.6
+     *
+     * @var int
+     */
+    const MAX_LINE_LENGTH = 998;
+
+    /**
+     * The maximum line length allowed for replies in RFC 5321 section 4.5.3.1.5,
+     * *including* a trailing CRLF line break.
+     *
+     * @see https://www.rfc-editor.org/rfc/rfc5321#section-4.5.3.1.5
+     *
+     * @var int
+     */
+    const MAX_REPLY_LENGTH = 512;
+
+    /**
+     * Debug level for no output.
+     *
+     * @var int
+     */
+    const DEBUG_OFF = 0;
+
+    /**
+     * Debug level to show client -> server messages.
+     *
+     * @var int
+     */
+    const DEBUG_CLIENT = 1;
+
+    /**
+     * Debug level to show client -> server and server -> client messages.
+     *
+     * @var int
+     */
+    const DEBUG_SERVER = 2;
+
+    /**
+     * Debug level to show connection status, client -> server and server -> client messages.
+     *
+     * @var int
+     */
+    const DEBUG_CONNECTION = 3;
+
+    /**
+     * Debug level to show all messages.
+     *
+     * @var int
+     */
+    const DEBUG_LOWLEVEL = 4;
+
+    /**
+     * Debug output level.
+     * Options:
+     * * self::DEBUG_OFF (`0`) No debug output, default
+     * * self::DEBUG_CLIENT (`1`) Client commands
+     * * self::DEBUG_SERVER (`2`) Client commands and server responses
+     * * self::DEBUG_CONNECTION (`3`) As DEBUG_SERVER plus connection status
+     * * self::DEBUG_LOWLEVEL (`4`) Low-level data output, all messages.
+     *
+     * @var int
+     */
+    public $do_debug = self::DEBUG_OFF;
+
+    /**
+     * How to handle debug output.
+     * Options:
+     * * `echo` Output plain-text as-is, appropriate for CLI
+     * * `html` Output escaped, line breaks converted to `<br>`, appropriate for browser output
+     * * `error_log` Output to error log as configured in php.ini
+     * Alternatively, you can provide a callable expecting two params: a message string and the debug level:
+     *
+     * ```php
+     * $smtp->Debugoutput = function($str, $level) {echo "debug level $level; message: $str";};
+     * ```
+     *
+     * Alternatively, you can pass in an instance of a PSR-3 compatible logger, though only `debug`
+     * level output is used:
+     *
+     * ```php
+     * $mail->Debugoutput = new myPsr3Logger;
+     * ```
+     *
+     * @var string|callable|\Psr\Log\LoggerInterface
+     */
+    public $Debugoutput = 'echo';
+
+    /**
+     * Whether to use VERP.
+     *
+     * @see https://en.wikipedia.org/wiki/Variable_envelope_return_path
+     * @see https://www.postfix.org/VERP_README.html Info on VERP
+     *
+     * @var bool
+     */
+    public $do_verp = false;
+
+    /**
+     * The timeout value for connection, in seconds.
+     * Default of 5 minutes (300sec) is from RFC2821 section 4.5.3.2.
+     * This needs to be quite high to function correctly with hosts using greetdelay as an anti-spam measure.
+     *
+     * @see https://www.rfc-editor.org/rfc/rfc2821#section-4.5.3.2
+     *
+     * @var int
+     */
+    public $Timeout = 300;
+
+    /**
+     * How long to wait for commands to complete, in seconds.
+     * Default of 5 minutes (300sec) is from RFC2821 section 4.5.3.2.
+     *
+     * @var int
+     */
+    public $Timelimit = 300;
+
+    /**
+     * Patterns to extract an SMTP transaction id from reply to a DATA command.
+     * The first capture group in each regex will be used as the ID.
+     * MS ESMTP returns the message ID, which may not be correct for internal tracking.
+     *
+     * @var string[]
+     */
+    protected $smtp_transaction_id_patterns = [
+        'exim' => '/[\d]{3} OK id=(.*)/',
+        'sendmail' => '/[\d]{3} 2\.0\.0 (.*) Message/',
+        'postfix' => '/[\d]{3} 2\.0\.0 Ok: queued as (.*)/',
+        'Microsoft_ESMTP' => '/[0-9]{3} 2\.[\d]\.0 (.*)@(?:.*) Queued mail for delivery/',
+        'Amazon_SES' => '/[\d]{3} Ok (.*)/',
+        'SendGrid' => '/[\d]{3} Ok: queued as (.*)/',
+        'CampaignMonitor' => '/[\d]{3} 2\.0\.0 OK:([a-zA-Z\d]{48})/',
+        'Haraka' => '/[\d]{3} Message Queued \((.*)\)/',
+        'ZoneMTA' => '/[\d]{3} Message queued as (.*)/',
+        'Mailjet' => '/[\d]{3} OK queued as (.*)/',
+    ];
+
+    /**
+     * Allowed SMTP XCLIENT attributes.
+     * Must be allowed by the SMTP server. EHLO response is not checked.
+     *
+     * @see https://www.postfix.org/XCLIENT_README.html
+     *
+     * @var array
+     */
+    public static $xclient_allowed_attributes = [
+        'NAME', 'ADDR', 'PORT', 'PROTO', 'HELO', 'LOGIN', 'DESTADDR', 'DESTPORT'
+    ];
+
+    /**
+     * The last transaction ID issued in response to a DATA command,
+     * if one was detected.
+     *
+     * @var string|bool|null
+     */
+    protected $last_smtp_transaction_id;
+
+    /**
+     * The socket for the server connection.
+     *
+     * @var ?resource
+     */
+    protected $smtp_conn;
+
+    /**
+     * Error information, if any, for the last SMTP command.
+     *
+     * @var array
+     */
+    protected $error = [
+        'error' => '',
+        'detail' => '',
+        'smtp_code' => '',
+        'smtp_code_ex' => '',
+    ];
+
+    /**
+     * The reply the server sent to us for HELO.
+     * If null, no HELO string has yet been received.
+     *
+     * @var string|null
+     */
+    protected $helo_rply;
+
+    /**
+     * The set of SMTP extensions sent in reply to EHLO command.
+     * Indexes of the array are extension names.
+     * Value at index 'HELO' or 'EHLO' (according to command that was sent)
+     * represents the server name. In case of HELO it is the only element of the array.
+     * Other values can be boolean TRUE or an array containing extension options.
+     * If null, no HELO/EHLO string has yet been received.
+     *
+     * @var array|null
+     */
+    protected $server_caps;
+
+    /**
+     * The most recent reply received from the server.
+     *
+     * @var string
+     */
+    protected $last_reply = '';
+
+    /**
+     * Output debugging info via a user-selected method.
+     *
+     * @param string $str   Debug string to output
+     * @param int    $level The debug level of this message; see DEBUG_* constants
+     *
+     * @see SMTP::$Debugoutput
+     * @see SMTP::$do_debug
+     */
+    protected function edebug($str, $level = 0)
+    {
+        if ($level > $this->do_debug) {
+            return;
+        }
+        //Is this a PSR-3 logger?
+        if ($this->Debugoutput instanceof \Psr\Log\LoggerInterface) {
+            //Remove trailing line breaks potentially added by calls to SMTP::client_send()
+            $this->Debugoutput->debug(rtrim($str, "\r\n"));
+
+            return;
+        }
+        //Avoid clash with built-in function names
+        if (is_callable($this->Debugoutput) && !in_array($this->Debugoutput, ['error_log', 'html', 'echo'])) {
+            call_user_func($this->Debugoutput, $str, $level);
+
+            return;
+        }
+        switch ($this->Debugoutput) {
+            case 'error_log':
+                //Don't output, just log
+                /** @noinspection ForgottenDebugOutputInspection */
+                error_log($str);
+                break;
+            case 'html':
+                //Cleans up output a bit for a better looking, HTML-safe output
+                echo gmdate('Y-m-d H:i:s'), ' ', htmlentities(
+                    preg_replace('/[\r\n]+/', '', $str),
+                    ENT_QUOTES,
+                    'UTF-8'
+                ), "<br>\n";
+                break;
+            case 'echo':
+            default:
+                //Normalize line breaks
+                $str = preg_replace('/\r\n|\r/m', "\n", $str);
+                echo gmdate('Y-m-d H:i:s'),
+                "\t",
+                    //Trim trailing space
+                trim(
+                    //Indent for readability, except for trailing break
+                    str_replace(
+                        "\n",
+                        "\n                   \t                  ",
+                        trim($str)
+                    )
+                ),
+                "\n";
+        }
+    }
+
+    /**
+     * Connect to an SMTP server.
+     *
+     * @param string $host    SMTP server IP or host name
+     * @param int    $port    The port number to connect to
+     * @param int    $timeout How long to wait for the connection to open
+     * @param array  $options An array of options for stream_context_create()
+     *
+     * @return bool
+     */
+    public function connect($host, $port = null, $timeout = 30, $options = [])
+    {
+        //Clear errors to avoid confusion
+        $this->setError('');
+        //Make sure we are __not__ connected
+        if ($this->connected()) {
+            //Already connected, generate error
+            $this->setError('Already connected to a server');
+
+            return false;
+        }
+        if (empty($port)) {
+            $port = self::DEFAULT_PORT;
+        }
+        //Connect to the SMTP server
+        $this->edebug(
+            "Connection: opening to $host:$port, timeout=$timeout, options=" .
+            (count($options) > 0 ? var_export($options, true) : 'array()'),
+            self::DEBUG_CONNECTION
+        );
+
+        $this->smtp_conn = $this->getSMTPConnection($host, $port, $timeout, $options);
+
+        if ($this->smtp_conn === false) {
+            //Error info already set inside `getSMTPConnection()`
+            return false;
+        }
+
+        $this->edebug('Connection: opened', self::DEBUG_CONNECTION);
+
+        //Get any announcement
+        $this->last_reply = $this->get_lines();
+        $this->edebug('SERVER -> CLIENT: ' . $this->last_reply, self::DEBUG_SERVER);
+        $responseCode = (int)substr($this->last_reply, 0, 3);
+        if ($responseCode === 220) {
+            return true;
+        }
+        //Anything other than a 220 response means something went wrong
+        //RFC 5321 says the server will wait for us to send a QUIT in response to a 554 error
+        //https://www.rfc-editor.org/rfc/rfc5321#section-3.1
+        if ($responseCode === 554) {
+            $this->quit();
+        }
+        //This will handle 421 responses which may not wait for a QUIT (e.g. if the server is being shut down)
+        $this->edebug('Connection: closing due to error', self::DEBUG_CONNECTION);
+        $this->close();
+        return false;
+    }
+
+    /**
+     * Create connection to the SMTP server.
+     *
+     * @param string $host    SMTP server IP or host name
+     * @param int    $port    The port number to connect to
+     * @param int    $timeout How long to wait for the connection to open
+     * @param array  $options An array of options for stream_context_create()
+     *
+     * @return false|resource
+     */
+    protected function getSMTPConnection($host, $port = null, $timeout = 30, $options = [])
+    {
+        static $streamok;
+        //This is enabled by default since 5.0.0 but some providers disable it
+        //Check this once and cache the result
+        if (null === $streamok) {
+            $streamok = function_exists('stream_socket_client');
+        }
+
+        $errno = 0;
+        $errstr = '';
+        if ($streamok) {
+            $socket_context = stream_context_create($options);
+            set_error_handler(function () {
+                call_user_func_array([$this, 'errorHandler'], func_get_args());
+            });
+            $connection = stream_socket_client(
+                $host . ':' . $port,
+                $errno,
+                $errstr,
+                $timeout,
+                STREAM_CLIENT_CONNECT,
+                $socket_context
+            );
+        } else {
+            //Fall back to fsockopen which should work in more places, but is missing some features
+            $this->edebug(
+                'Connection: stream_socket_client not available, falling back to fsockopen',
+                self::DEBUG_CONNECTION
+            );
+            set_error_handler(function () {
+                call_user_func_array([$this, 'errorHandler'], func_get_args());
+            });
+            $connection = fsockopen(
+                $host,
+                $port,
+                $errno,
+                $errstr,
+                $timeout
+            );
+        }
+        restore_error_handler();
+
+        //Verify we connected properly
+        if (!is_resource($connection)) {
+            $this->setError(
+                'Failed to connect to server',
+                '',
+                (string) $errno,
+                $errstr
+            );
+            $this->edebug(
+                'SMTP ERROR: ' . $this->error['error']
+                . ": $errstr ($errno)",
+                self::DEBUG_CLIENT
+            );
+
+            return false;
+        }
+
+        //SMTP server can take longer to respond, give longer timeout for first read
+        //Windows does not have support for this timeout function
+        if (strpos(PHP_OS, 'WIN') !== 0) {
+            $max = (int)ini_get('max_execution_time');
+            //Don't bother if unlimited, or if set_time_limit is disabled
+            if (0 !== $max && $timeout > $max && strpos(ini_get('disable_functions'), 'set_time_limit') === false) {
+                @set_time_limit($timeout);
+            }
+            stream_set_timeout($connection, $timeout, 0);
+        }
+
+        return $connection;
+    }
+
+    /**
+     * Initiate a TLS (encrypted) session.
+     *
+     * @return bool
+     */
+    public function startTLS()
+    {
+        if (!$this->sendCommand('STARTTLS', 'STARTTLS', 220)) {
+            return false;
+        }
+
+        //Allow the best TLS version(s) we can
+        $crypto_method = STREAM_CRYPTO_METHOD_TLS_CLIENT;
+
+        //PHP 5.6.7 dropped inclusion of TLS 1.1 and 1.2 in STREAM_CRYPTO_METHOD_TLS_CLIENT
+        //so add them back in manually if we can
+        if (defined('STREAM_CRYPTO_METHOD_TLSv1_2_CLIENT')) {
+            $crypto_method |= STREAM_CRYPTO_METHOD_TLSv1_2_CLIENT;
+            $crypto_method |= STREAM_CRYPTO_METHOD_TLSv1_1_CLIENT;
+        }
+
+        //Begin encrypted connection
+            set_error_handler(function () {
+                call_user_func_array([$this, 'errorHandler'], func_get_args());
+            });
+        $crypto_ok = stream_socket_enable_crypto(
+            $this->smtp_conn,
+            true,
+            $crypto_method
+        );
+        restore_error_handler();
+
+        return (bool) $crypto_ok;
+    }
+
+    /**
+     * Perform SMTP authentication.
+     * Must be run after hello().
+     *
+     * @see    hello()
+     *
+     * @param string $username The user name
+     * @param string $password The password
+     * @param string $authtype The auth type (CRAM-MD5, PLAIN, LOGIN, XOAUTH2)
+     * @param OAuthTokenProvider $OAuth An optional OAuthTokenProvider instance for XOAUTH2 authentication
+     *
+     * @return bool True if successfully authenticated
+     */
+    public function authenticate(
+        $username,
+        $password,
+        $authtype = null,
+        $OAuth = null
+    ) {
+        if (!$this->server_caps) {
+            $this->setError('Authentication is not allowed before HELO/EHLO');
+
+            return false;
+        }
+
+        if (array_key_exists('EHLO', $this->server_caps)) {
+            //SMTP extensions are available; try to find a proper authentication method
+            if (!array_key_exists('AUTH', $this->server_caps)) {
+                $this->setError('Authentication is not allowed at this stage');
+                //'at this stage' means that auth may be allowed after the stage changes
+                //e.g. after STARTTLS
+
+                return false;
+            }
+
+            $this->edebug('Auth method requested: ' . ($authtype ?: 'UNSPECIFIED'), self::DEBUG_LOWLEVEL);
+            $this->edebug(
+                'Auth methods available on the server: ' . implode(',', $this->server_caps['AUTH']),
+                self::DEBUG_LOWLEVEL
+            );
+
+            //If we have requested a specific auth type, check the server supports it before trying others
+            if (null !== $authtype && !in_array($authtype, $this->server_caps['AUTH'], true)) {
+                $this->edebug('Requested auth method not available: ' . $authtype, self::DEBUG_LOWLEVEL);
+                $authtype = null;
+            }
+
+            if (empty($authtype)) {
+                //If no auth mechanism is specified, attempt to use these, in this order
+                //Try CRAM-MD5 first as it's more secure than the others
+                foreach (['CRAM-MD5', 'LOGIN', 'PLAIN', 'XOAUTH2'] as $method) {
+                    if (in_array($method, $this->server_caps['AUTH'], true)) {
+                        $authtype = $method;
+                        break;
+                    }
+                }
+                if (empty($authtype)) {
+                    $this->setError('No supported authentication methods found');
+
+                    return false;
+                }
+                $this->edebug('Auth method selected: ' . $authtype, self::DEBUG_LOWLEVEL);
+            }
+
+            if (!in_array($authtype, $this->server_caps['AUTH'], true)) {
+                $this->setError("The requested authentication method \"$authtype\" is not supported by the server");
+
+                return false;
+            }
+        } elseif (empty($authtype)) {
+            $authtype = 'LOGIN';
+        }
+        switch ($authtype) {
+            case 'PLAIN':
+                //Start authentication
+                if (!$this->sendCommand('AUTH', 'AUTH PLAIN', 334)) {
+                    return false;
+                }
+                //Send encoded username and password
+                if (
+                    //Format from https://www.rfc-editor.org/rfc/rfc4616#section-2
+                    //We skip the first field (it's forgery), so the string starts with a null byte
+                    !$this->sendCommand(
+                        'User & Password',
+                        base64_encode("\0" . $username . "\0" . $password),
+                        235
+                    )
+                ) {
+                    return false;
+                }
+                break;
+            case 'LOGIN':
+                //Start authentication
+                if (!$this->sendCommand('AUTH', 'AUTH LOGIN', 334)) {
+                    return false;
+                }
+                if (!$this->sendCommand('Username', base64_encode($username), 334)) {
+                    return false;
+                }
+                if (!$this->sendCommand('Password', base64_encode($password), 235)) {
+                    return false;
+                }
+                break;
+            case 'CRAM-MD5':
+                //Start authentication
+                if (!$this->sendCommand('AUTH CRAM-MD5', 'AUTH CRAM-MD5', 334)) {
+                    return false;
+                }
+                //Get the challenge
+                $challenge = base64_decode(substr($this->last_reply, 4));
+
+                //Build the response
+                $response = $username . ' ' . $this->hmac($challenge, $password);
+
+                //send encoded credentials
+                return $this->sendCommand('Username', base64_encode($response), 235);
+            case 'XOAUTH2':
+                //The OAuth instance must be set up prior to requesting auth.
+                if (null === $OAuth) {
+                    return false;
+                }
+                $oauth = $OAuth->getOauth64();
+
+                //Start authentication
+                if (!$this->sendCommand('AUTH', 'AUTH XOAUTH2 ' . $oauth, 235)) {
+                    return false;
+                }
+                break;
+            default:
+                $this->setError("Authentication method \"$authtype\" is not supported");
+
+                return false;
+        }
+
+        return true;
+    }
+
+    /**
+     * Calculate an MD5 HMAC hash.
+     * Works like hash_hmac('md5', $data, $key)
+     * in case that function is not available.
+     *
+     * @param string $data The data to hash
+     * @param string $key  The key to hash with
+     *
+     * @return string
+     */
+    protected function hmac($data, $key)
+    {
+        if (function_exists('hash_hmac')) {
+            return hash_hmac('md5', $data, $key);
+        }
+
+        //The following borrowed from
+        //https://www.php.net/manual/en/function.mhash.php#27225
+
+        //RFC 2104 HMAC implementation for php.
+        //Creates an md5 HMAC.
+        //Eliminates the need to install mhash to compute a HMAC
+        //by Lance Rushing
+
+        $bytelen = 64; //byte length for md5
+        if (strlen($key) > $bytelen) {
+            $key = pack('H*', md5($key));
+        }
+        $key = str_pad($key, $bytelen, chr(0x00));
+        $ipad = str_pad('', $bytelen, chr(0x36));
+        $opad = str_pad('', $bytelen, chr(0x5c));
+        $k_ipad = $key ^ $ipad;
+        $k_opad = $key ^ $opad;
+
+        return md5($k_opad . pack('H*', md5($k_ipad . $data)));
+    }
+
+    /**
+     * Check connection state.
+     *
+     * @return bool True if connected
+     */
+    public function connected()
+    {
+        if (is_resource($this->smtp_conn)) {
+            $sock_status = stream_get_meta_data($this->smtp_conn);
+            if ($sock_status['eof']) {
+                //The socket is valid but we are not connected
+                $this->edebug(
+                    'SMTP NOTICE: EOF caught while checking if connected',
+                    self::DEBUG_CLIENT
+                );
+                $this->close();
+
+                return false;
+            }
+
+            return true; //everything looks good
+        }
+
+        return false;
+    }
+
+    /**
+     * Close the socket and clean up the state of the class.
+     * Don't use this function without first trying to use QUIT.
+     *
+     * @see quit()
+     */
+    public function close()
+    {
+        $this->server_caps = null;
+        $this->helo_rply = null;
+        if (is_resource($this->smtp_conn)) {
+            //Close the connection and cleanup
+            fclose($this->smtp_conn);
+            $this->smtp_conn = null; //Makes for cleaner serialization
+            $this->edebug('Connection: closed', self::DEBUG_CONNECTION);
+        }
+    }
+
+    /**
+     * Send an SMTP DATA command.
+     * Issues a data command and sends the msg_data to the server,
+     * finalizing the mail transaction. $msg_data is the message
+     * that is to be sent with the headers. Each header needs to be
+     * on a single line followed by a <CRLF> with the message headers
+     * and the message body being separated by an additional <CRLF>.
+     * Implements RFC 821: DATA <CRLF>.
+     *
+     * @param string $msg_data Message data to send
+     *
+     * @return bool
+     */
+    public function data($msg_data)
+    {
+        //This will use the standard timelimit
+        if (!$this->sendCommand('DATA', 'DATA', 354)) {
+            return false;
+        }
+
+        /* The server is ready to accept data!
+         * According to rfc821 we should not send more than 1000 characters on a single line (including the LE)
+         * so we will break the data up into lines by \r and/or \n then if needed we will break each of those into
+         * smaller lines to fit within the limit.
+         * We will also look for lines that start with a '.' and prepend an additional '.'.
+         * NOTE: this does not count towards line-length limit.
+         */
+
+        //Normalize line breaks before exploding
+        $lines = explode("\n", str_replace(["\r\n", "\r"], "\n", $msg_data));
+
+        /* To distinguish between a complete RFC822 message and a plain message body, we check if the first field
+         * of the first line (':' separated) does not contain a space then it _should_ be a header, and we will
+         * process all lines before a blank line as headers.
+         */
+
+        $field = substr($lines[0], 0, strpos($lines[0], ':'));
+        $in_headers = false;
+        if (!empty($field) && strpos($field, ' ') === false) {
+            $in_headers = true;
+        }
+
+        foreach ($lines as $line) {
+            $lines_out = [];
+            if ($in_headers && $line === '') {
+                $in_headers = false;
+            }
+            //Break this line up into several smaller lines if it's too long
+            //Micro-optimisation: isset($str[$len]) is faster than (strlen($str) > $len),
+            while (isset($line[self::MAX_LINE_LENGTH])) {
+                //Working backwards, try to find a space within the last MAX_LINE_LENGTH chars of the line to break on
+                //so as to avoid breaking in the middle of a word
+                $pos = strrpos(substr($line, 0, self::MAX_LINE_LENGTH), ' ');
+                //Deliberately matches both false and 0
+                if (!$pos) {
+                    //No nice break found, add a hard break
+                    $pos = self::MAX_LINE_LENGTH - 1;
+                    $lines_out[] = substr($line, 0, $pos);
+                    $line = substr($line, $pos);
+                } else {
+                    //Break at the found point
+                    $lines_out[] = substr($line, 0, $pos);
+                    //Move along by the amount we dealt with
+                    $line = substr($line, $pos + 1);
+                }
+                //If processing headers add a LWSP-char to the front of new line RFC822 section 3.1.1
+                if ($in_headers) {
+                    $line = "\t" . $line;
+                }
+            }
+            $lines_out[] = $line;
+
+            //Send the lines to the server
+            foreach ($lines_out as $line_out) {
+                //Dot-stuffing as per RFC5321 section 4.5.2
+                //https://www.rfc-editor.org/rfc/rfc5321#section-4.5.2
+                if (!empty($line_out) && $line_out[0] === '.') {
+                    $line_out = '.' . $line_out;
+                }
+                $this->client_send($line_out . static::LE, 'DATA');
+            }
+        }
+
+        //Message data has been sent, complete the command
+        //Increase timelimit for end of DATA command
+        $savetimelimit = $this->Timelimit;
+        $this->Timelimit *= 2;
+        $result = $this->sendCommand('DATA END', '.', 250);
+        $this->recordLastTransactionID();
+        //Restore timelimit
+        $this->Timelimit = $savetimelimit;
+
+        return $result;
+    }
+
+    /**
+     * Send an SMTP HELO or EHLO command.
+     * Used to identify the sending server to the receiving server.
+     * This makes sure that client and server are in a known state.
+     * Implements RFC 821: HELO <SP> <domain> <CRLF>
+     * and RFC 2821 EHLO.
+     *
+     * @param string $host The host name or IP to connect to
+     *
+     * @return bool
+     */
+    public function hello($host = '')
+    {
+        //Try extended hello first (RFC 2821)
+        if ($this->sendHello('EHLO', $host)) {
+            return true;
+        }
+
+        //Some servers shut down the SMTP service here (RFC 5321)
+        if (substr($this->helo_rply, 0, 3) == '421') {
+            return false;
+        }
+
+        return $this->sendHello('HELO', $host);
+    }
+
+    /**
+     * Send an SMTP HELO or EHLO command.
+     * Low-level implementation used by hello().
+     *
+     * @param string $hello The HELO string
+     * @param string $host  The hostname to say we are
+     *
+     * @return bool
+     *
+     * @see hello()
+     */
+    protected function sendHello($hello, $host)
+    {
+        $noerror = $this->sendCommand($hello, $hello . ' ' . $host, 250);
+        $this->helo_rply = $this->last_reply;
+        if ($noerror) {
+            $this->parseHelloFields($hello);
+        } else {
+            $this->server_caps = null;
+        }
+
+        return $noerror;
+    }
+
+    /**
+     * Parse a reply to HELO/EHLO command to discover server extensions.
+     * In case of HELO, the only parameter that can be discovered is a server name.
+     *
+     * @param string $type `HELO` or `EHLO`
+     */
+    protected function parseHelloFields($type)
+    {
+        $this->server_caps = [];
+        $lines = explode("\n", $this->helo_rply);
+
+        foreach ($lines as $n => $s) {
+            //First 4 chars contain response code followed by - or space
+            $s = trim(substr($s, 4));
+            if (empty($s)) {
+                continue;
+            }
+            $fields = explode(' ', $s);
+            if (!empty($fields)) {
+                if (!$n) {
+                    $name = $type;
+                    $fields = $fields[0];
+                } else {
+                    $name = array_shift($fields);
+                    switch ($name) {
+                        case 'SIZE':
+                            $fields = ($fields ? $fields[0] : 0);
+                            break;
+                        case 'AUTH':
+                            if (!is_array($fields)) {
+                                $fields = [];
+                            }
+                            break;
+                        default:
+                            $fields = true;
+                    }
+                }
+                $this->server_caps[$name] = $fields;
+            }
+        }
+    }
+
+    /**
+     * Send an SMTP MAIL command.
+     * Starts a mail transaction from the email address specified in
+     * $from. Returns true if successful or false otherwise. If True
+     * the mail transaction is started and then one or more recipient
+     * commands may be called followed by a data command.
+     * Implements RFC 821: MAIL <SP> FROM:<reverse-path> <CRLF>.
+     *
+     * @param string $from Source address of this message
+     *
+     * @return bool
+     */
+    public function mail($from)
+    {
+        $useVerp = ($this->do_verp ? ' XVERP' : '');
+
+        return $this->sendCommand(
+            'MAIL FROM',
+            'MAIL FROM:<' . $from . '>' . $useVerp,
+            250
+        );
+    }
+
+    /**
+     * Send an SMTP QUIT command.
+     * Closes the socket if there is no error or the $close_on_error argument is true.
+     * Implements from RFC 821: QUIT <CRLF>.
+     *
+     * @param bool $close_on_error Should the connection close if an error occurs?
+     *
+     * @return bool
+     */
+    public function quit($close_on_error = true)
+    {
+        $noerror = $this->sendCommand('QUIT', 'QUIT', 221);
+        $err = $this->error; //Save any error
+        if ($noerror || $close_on_error) {
+            $this->close();
+            $this->error = $err; //Restore any error from the quit command
+        }
+
+        return $noerror;
+    }
+
+    /**
+     * Send an SMTP RCPT command.
+     * Sets the TO argument to $toaddr.
+     * Returns true if the recipient was accepted false if it was rejected.
+     * Implements from RFC 821: RCPT <SP> TO:<forward-path> <CRLF>.
+     *
+     * @param string $address The address the message is being sent to
+     * @param string $dsn     Comma separated list of DSN notifications. NEVER, SUCCESS, FAILURE
+     *                        or DELAY. If you specify NEVER all other notifications are ignored.
+     *
+     * @return bool
+     */
+    public function recipient($address, $dsn = '')
+    {
+        if (empty($dsn)) {
+            $rcpt = 'RCPT TO:<' . $address . '>';
+        } else {
+            $dsn = strtoupper($dsn);
+            $notify = [];
+
+            if (strpos($dsn, 'NEVER') !== false) {
+                $notify[] = 'NEVER';
+            } else {
+                foreach (['SUCCESS', 'FAILURE', 'DELAY'] as $value) {
+                    if (strpos($dsn, $value) !== false) {
+                        $notify[] = $value;
+                    }
+                }
+            }
+
+            $rcpt = 'RCPT TO:<' . $address . '> NOTIFY=' . implode(',', $notify);
+        }
+
+        return $this->sendCommand(
+            'RCPT TO',
+            $rcpt,
+            [250, 251]
+        );
+    }
+
+    /**
+     * Send SMTP XCLIENT command to server and check its return code.
+     *
+     * @return bool True on success
+     */
+    public function xclient(array $vars)
+    {
+        $xclient_options = "";
+        foreach ($vars as $key => $value) {
+            if (in_array($key, SMTP::$xclient_allowed_attributes)) {
+                $xclient_options .= " {$key}={$value}";
+            }
+        }
+        if (!$xclient_options) {
+            return true;
+        }
+        return $this->sendCommand('XCLIENT', 'XCLIENT' . $xclient_options, 250);
+    }
+
+    /**
+     * Send an SMTP RSET command.
+     * Abort any transaction that is currently in progress.
+     * Implements RFC 821: RSET <CRLF>.
+     *
+     * @return bool True on success
+     */
+    public function reset()
+    {
+        return $this->sendCommand('RSET', 'RSET', 250);
+    }
+
+    /**
+     * Send a command to an SMTP server and check its return code.
+     *
+     * @param string    $command       The command name - not sent to the server
+     * @param string    $commandstring The actual command to send
+     * @param int|array $expect        One or more expected integer success codes
+     *
+     * @return bool True on success
+     */
+    protected function sendCommand($command, $commandstring, $expect)
+    {
+        if (!$this->connected()) {
+            $this->setError("Called $command without being connected");
+
+            return false;
+        }
+        //Reject line breaks in all commands
+        if ((strpos($commandstring, "\n") !== false) || (strpos($commandstring, "\r") !== false)) {
+            $this->setError("Command '$command' contained line breaks");
+
+            return false;
+        }
+        $this->client_send($commandstring . static::LE, $command);
+
+        $this->last_reply = $this->get_lines();
+        //Fetch SMTP code and possible error code explanation
+        $matches = [];
+        if (preg_match('/^([\d]{3})[ -](?:([\d]\\.[\d]\\.[\d]{1,2}) )?/', $this->last_reply, $matches)) {
+            $code = (int) $matches[1];
+            $code_ex = (count($matches) > 2 ? $matches[2] : null);
+            //Cut off error code from each response line
+            $detail = preg_replace(
+                "/{$code}[ -]" .
+                ($code_ex ? str_replace('.', '\\.', $code_ex) . ' ' : '') . '/m',
+                '',
+                $this->last_reply
+            );
+        } else {
+            //Fall back to simple parsing if regex fails
+            $code = (int) substr($this->last_reply, 0, 3);
+            $code_ex = null;
+            $detail = substr($this->last_reply, 4);
+        }
+
+        $this->edebug('SERVER -> CLIENT: ' . $this->last_reply, self::DEBUG_SERVER);
+
+        if (!in_array($code, (array) $expect, true)) {
+            $this->setError(
+                "$command command failed",
+                $detail,
+                $code,
+                $code_ex
+            );
+            $this->edebug(
+                'SMTP ERROR: ' . $this->error['error'] . ': ' . $this->last_reply,
+                self::DEBUG_CLIENT
+            );
+
+            return false;
+        }
+
+        //Don't clear the error store when using keepalive
+        if ($command !== 'RSET') {
+            $this->setError('');
+        }
+
+        return true;
+    }
+
+    /**
+     * Send an SMTP SAML command.
+     * Starts a mail transaction from the email address specified in $from.
+     * Returns true if successful or false otherwise. If True
+     * the mail transaction is started and then one or more recipient
+     * commands may be called followed by a data command. This command
+     * will send the message to the users terminal if they are logged
+     * in and send them an email.
+     * Implements RFC 821: SAML <SP> FROM:<reverse-path> <CRLF>.
+     *
+     * @param string $from The address the message is from
+     *
+     * @return bool
+     */
+    public function sendAndMail($from)
+    {
+        return $this->sendCommand('SAML', "SAML FROM:$from", 250);
+    }
+
+    /**
+     * Send an SMTP VRFY command.
+     *
+     * @param string $name The name to verify
+     *
+     * @return bool
+     */
+    public function verify($name)
+    {
+        return $this->sendCommand('VRFY', "VRFY $name", [250, 251]);
+    }
+
+    /**
+     * Send an SMTP NOOP command.
+     * Used to keep keep-alives alive, doesn't actually do anything.
+     *
+     * @return bool
+     */
+    public function noop()
+    {
+        return $this->sendCommand('NOOP', 'NOOP', 250);
+    }
+
+    /**
+     * Send an SMTP TURN command.
+     * This is an optional command for SMTP that this class does not support.
+     * This method is here to make the RFC821 Definition complete for this class
+     * and _may_ be implemented in future.
+     * Implements from RFC 821: TURN <CRLF>.
+     *
+     * @return bool
+     */
+    public function turn()
+    {
+        $this->setError('The SMTP TURN command is not implemented');
+        $this->edebug('SMTP NOTICE: ' . $this->error['error'], self::DEBUG_CLIENT);
+
+        return false;
+    }
+
+    /**
+     * Send raw data to the server.
+     *
+     * @param string $data    The data to send
+     * @param string $command Optionally, the command this is part of, used only for controlling debug output
+     *
+     * @return int|bool The number of bytes sent to the server or false on error
+     */
+    public function client_send($data, $command = '')
+    {
+        //If SMTP transcripts are left enabled, or debug output is posted online
+        //it can leak credentials, so hide credentials in all but lowest level
+        if (
+            self::DEBUG_LOWLEVEL > $this->do_debug &&
+            in_array($command, ['User & Password', 'Username', 'Password'], true)
+        ) {
+            $this->edebug('CLIENT -> SERVER: [credentials hidden]', self::DEBUG_CLIENT);
+        } else {
+            $this->edebug('CLIENT -> SERVER: ' . $data, self::DEBUG_CLIENT);
+        }
+        set_error_handler(function () {
+            call_user_func_array([$this, 'errorHandler'], func_get_args());
+        });
+        $result = fwrite($this->smtp_conn, $data);
+        restore_error_handler();
+
+        return $result;
+    }
+
+    /**
+     * Get the latest error.
+     *
+     * @return array
+     */
+    public function getError()
+    {
+        return $this->error;
+    }
+
+    /**
+     * Get SMTP extensions available on the server.
+     *
+     * @return array|null
+     */
+    public function getServerExtList()
+    {
+        return $this->server_caps;
+    }
+
+    /**
+     * Get metadata about the SMTP server from its HELO/EHLO response.
+     * The method works in three ways, dependent on argument value and current state:
+     *   1. HELO/EHLO has not been sent - returns null and populates $this->error.
+     *   2. HELO has been sent -
+     *     $name == 'HELO': returns server name
+     *     $name == 'EHLO': returns boolean false
+     *     $name == any other string: returns null and populates $this->error
+     *   3. EHLO has been sent -
+     *     $name == 'HELO'|'EHLO': returns the server name
+     *     $name == any other string: if extension $name exists, returns True
+     *       or its options (e.g. AUTH mechanisms supported). Otherwise returns False.
+     *
+     * @param string $name Name of SMTP extension or 'HELO'|'EHLO'
+     *
+     * @return string|bool|null
+     */
+    public function getServerExt($name)
+    {
+        if (!$this->server_caps) {
+            $this->setError('No HELO/EHLO was sent');
+
+            return null;
+        }
+
+        if (!array_key_exists($name, $this->server_caps)) {
+            if ('HELO' === $name) {
+                return $this->server_caps['EHLO'];
+            }
+            if ('EHLO' === $name || array_key_exists('EHLO', $this->server_caps)) {
+                return false;
+            }
+            $this->setError('HELO handshake was used; No information about server extensions available');
+
+            return null;
+        }
+
+        return $this->server_caps[$name];
+    }
+
+    /**
+     * Get the last reply from the server.
+     *
+     * @return string
+     */
+    public function getLastReply()
+    {
+        return $this->last_reply;
+    }
+
+    /**
+     * Read the SMTP server's response.
+     * Either before eof or socket timeout occurs on the operation.
+     * With SMTP we can tell if we have more lines to read if the
+     * 4th character is '-' symbol. If it is a space then we don't
+     * need to read anything else.
+     *
+     * @return string
+     */
+    protected function get_lines()
+    {
+        //If the connection is bad, give up straight away
+        if (!is_resource($this->smtp_conn)) {
+            return '';
+        }
+        $data = '';
+        $endtime = 0;
+        stream_set_timeout($this->smtp_conn, $this->Timeout);
+        if ($this->Timelimit > 0) {
+            $endtime = time() + $this->Timelimit;
+        }
+        $selR = [$this->smtp_conn];
+        $selW = null;
+        while (is_resource($this->smtp_conn) && !feof($this->smtp_conn)) {
+            //Must pass vars in here as params are by reference
+            //solution for signals inspired by https://github.com/symfony/symfony/pull/6540
+            set_error_handler(function () {
+                call_user_func_array([$this, 'errorHandler'], func_get_args());
+            });
+            $n = stream_select($selR, $selW, $selW, $this->Timelimit);
+            restore_error_handler();
+
+            if ($n === false) {
+                $message = $this->getError()['detail'];
+
+                $this->edebug(
+                    'SMTP -> get_lines(): select failed (' . $message . ')',
+                    self::DEBUG_LOWLEVEL
+                );
+
+                //stream_select returns false when the `select` system call is interrupted
+                //by an incoming signal, try the select again
+                if (stripos($message, 'interrupted system call') !== false) {
+                    $this->edebug(
+                        'SMTP -> get_lines(): retrying stream_select',
+                        self::DEBUG_LOWLEVEL
+                    );
+                    $this->setError('');
+                    continue;
+                }
+
+                break;
+            }
+
+            if (!$n) {
+                $this->edebug(
+                    'SMTP -> get_lines(): select timed-out in (' . $this->Timelimit . ' sec)',
+                    self::DEBUG_LOWLEVEL
+                );
+                break;
+            }
+
+            //Deliberate noise suppression - errors are handled afterwards
+            $str = @fgets($this->smtp_conn, self::MAX_REPLY_LENGTH);
+            $this->edebug('SMTP INBOUND: "' . trim($str) . '"', self::DEBUG_LOWLEVEL);
+            $data .= $str;
+            //If response is only 3 chars (not valid, but RFC5321 S4.2 says it must be handled),
+            //or 4th character is a space or a line break char, we are done reading, break the loop.
+            //String array access is a significant micro-optimisation over strlen
+            if (!isset($str[3]) || $str[3] === ' ' || $str[3] === "\r" || $str[3] === "\n") {
+                break;
+            }
+            //Timed-out? Log and break
+            $info = stream_get_meta_data($this->smtp_conn);
+            if ($info['timed_out']) {
+                $this->edebug(
+                    'SMTP -> get_lines(): stream timed-out (' . $this->Timeout . ' sec)',
+                    self::DEBUG_LOWLEVEL
+                );
+                break;
+            }
+            //Now check if reads took too long
+            if ($endtime && time() > $endtime) {
+                $this->edebug(
+                    'SMTP -> get_lines(): timelimit reached (' .
+                    $this->Timelimit . ' sec)',
+                    self::DEBUG_LOWLEVEL
+                );
+                break;
+            }
+        }
+
+        return $data;
+    }
+
+    /**
+     * Enable or disable VERP address generation.
+     *
+     * @param bool $enabled
+     */
+    public function setVerp($enabled = false)
+    {
+        $this->do_verp = $enabled;
+    }
+
+    /**
+     * Get VERP address generation mode.
+     *
+     * @return bool
+     */
+    public function getVerp()
+    {
+        return $this->do_verp;
+    }
+
+    /**
+     * Set error messages and codes.
+     *
+     * @param string $message      The error message
+     * @param string $detail       Further detail on the error
+     * @param string $smtp_code    An associated SMTP error code
+     * @param string $smtp_code_ex Extended SMTP code
+     */
+    protected function setError($message, $detail = '', $smtp_code = '', $smtp_code_ex = '')
+    {
+        $this->error = [
+            'error' => $message,
+            'detail' => $detail,
+            'smtp_code' => $smtp_code,
+            'smtp_code_ex' => $smtp_code_ex,
+        ];
+    }
+
+    /**
+     * Set debug output method.
+     *
+     * @param string|callable $method The name of the mechanism to use for debugging output, or a callable to handle it
+     */
+    public function setDebugOutput($method = 'echo')
+    {
+        $this->Debugoutput = $method;
+    }
+
+    /**
+     * Get debug output method.
+     *
+     * @return string
+     */
+    public function getDebugOutput()
+    {
+        return $this->Debugoutput;
+    }
+
+    /**
+     * Set debug output level.
+     *
+     * @param int $level
+     */
+    public function setDebugLevel($level = 0)
+    {
+        $this->do_debug = $level;
+    }
+
+    /**
+     * Get debug output level.
+     *
+     * @return int
+     */
+    public function getDebugLevel()
+    {
+        return $this->do_debug;
+    }
+
+    /**
+     * Set SMTP timeout.
+     *
+     * @param int $timeout The timeout duration in seconds
+     */
+    public function setTimeout($timeout = 0)
+    {
+        $this->Timeout = $timeout;
+    }
+
+    /**
+     * Get SMTP timeout.
+     *
+     * @return int
+     */
+    public function getTimeout()
+    {
+        return $this->Timeout;
+    }
+
+    /**
+     * Reports an error number and string.
+     *
+     * @param int    $errno   The error number returned by PHP
+     * @param string $errmsg  The error message returned by PHP
+     * @param string $errfile The file the error occurred in
+     * @param int    $errline The line number the error occurred on
+     */
+    protected function errorHandler($errno, $errmsg, $errfile = '', $errline = 0)
+    {
+        $notice = 'Connection failed.';
+        $this->setError(
+            $notice,
+            $errmsg,
+            (string) $errno
+        );
+        $this->edebug(
+            "$notice Error #$errno: $errmsg [$errfile line $errline]",
+            self::DEBUG_CONNECTION
+        );
+    }
+
+    /**
+     * Extract and return the ID of the last SMTP transaction based on
+     * a list of patterns provided in SMTP::$smtp_transaction_id_patterns.
+     * Relies on the host providing the ID in response to a DATA command.
+     * If no reply has been received yet, it will return null.
+     * If no pattern was matched, it will return false.
+     *
+     * @return bool|string|null
+     */
+    protected function recordLastTransactionID()
+    {
+        $reply = $this->getLastReply();
+
+        if (empty($reply)) {
+            $this->last_smtp_transaction_id = null;
+        } else {
+            $this->last_smtp_transaction_id = false;
+            foreach ($this->smtp_transaction_id_patterns as $smtp_transaction_id_pattern) {
+                $matches = [];
+                if (preg_match($smtp_transaction_id_pattern, $reply, $matches)) {
+                    $this->last_smtp_transaction_id = trim($matches[1]);
+                    break;
+                }
+            }
+        }
+
+        return $this->last_smtp_transaction_id;
+    }
+
+    /**
+     * Get the queue/transaction ID of the last SMTP transaction
+     * If no reply has been received yet, it will return null.
+     * If no pattern was matched, it will return false.
+     *
+     * @return bool|string|null
+     *
+     * @see recordLastTransactionID()
+     */
+    public function getLastTransactionID()
+    {
+        return $this->last_smtp_transaction_id;
+    }
+}

backup_2026-05-04/PROJECT_OVERVIEW.md

@@ -0,0 +1,32 @@
+# Martechsol Chat Assistant - Project Overview
+
+This document explains how your RAG (Retrieval-Augmented Generation) chatbot works in simple terms.
+
+## 1. The "Brain" (The AI Model)
+The assistant uses a hybrid LLM approach:
+- **Qwen 2.5 32B** (specifically `qwen/qwen3-32b`) as the main reasoning and generation engine.
+- **Llama 3.1 8B** (specifically `llama-3.1-8b-instant`) as a lightning-fast model for query rewriting and expansion.
+- **Provider**: Both are powered by **Groq**, enabling near-instantaneous responses.
+
+## 2. How it Works (The "RAG" Process)
+Instead of just relying on general knowledge, this bot "reads" your documents to give specific answers.
+1. **Reading**: It looks at your files in the `docs/` folder (PDFs and Text files).
+2. **Memorizing**: It breaks the text into small chunks and converts them into mathematical "vectors" (using the `bge-small-en-v1.5` model).
+3. **Searching**: When you ask a question, it expands the query using Llama 3.1 8B, then performs a **Hybrid Search** combining Dense vectors (**FAISS**) and Keyword search (**BM25**).
+4. **Reranking**: It deeply evaluates the top retrieved chunks using `bge-reranker-base` to ensure maximum relevance.
+5. **Answering**: It sends your question along with the most relevant document parts to the Qwen 2.5 AI, which then writes a highly precise, formatted reply.
+
+## 3. The Architecture
+### Frontend (The Face)
+- **Gradio**: This is the clean, chat-like interface you see. It is hosted on **Hugging Face Spaces**.
+- **WordPress Addon**: A custom HTML/CSS/JS wrapper that lets you embed the chat as a beautiful floating button on your website.
+
+### Backend (The Engine)
+- **FastAPI**: A high-performance Python framework that connects everything. It manages the messages, handles the document search, and talks to the AI provider.
+- **Uvicorn**: The lightning-fast server that runs the FastAPI code.
+
+## 4. Key Features
+- **Humanistic Replies**: The bot is programmed to be polite, conversational, and professional.
+- **Context-Aware**: It remembers the last few messages in the conversation so you can ask follow-up questions.
+- **Greeting Support**: It can handle "Hi" and "Hello" naturally before getting down to business.
+- **Safe & Grounded**: It is instructed to only answer based on your documents to prevent "hallucinations" (making things up).

backup_2026-05-04/README.md

@@ -0,0 +1,164 @@
+---
+title: Fast RAG Chatbot
+emoji: 🤖
+colorFrom: blue
+colorTo: indigo
+sdk: docker
+pinned: false
+storage: true
+---
+
+# High-Performance RAG Chatbot (FastAPI + FAISS)
+
+Production-style document QA chatbot using:
+- FastAPI API service
+- FAISS vector search
+- SentenceTransformer embeddings (`BAAI/bge-small-en-v1.5` by default)
+- Groq (preferred) or Hugging Face LLM APIs
+- Optional Gradio chat UI
+
+## Features
+
+- Loads `.pdf` and `.txt` files from `docs/`
+- Cleans extracted text and chunks into semantic windows
+  - Chunk size: 420 tokens (word-level approximation)
+  - Overlap: 80 tokens
+- Builds FAISS index and saves it locally
+- Re-indexes only when docs change (fingerprint-based cache)
+- Retrieves top-k relevant chunks only (default k=4)
+- Strict anti-hallucination prompt
+- Health endpoint with docs/index status
+- Retrieval logging (source + similarity score)
+- CORS controls for website integration
+- Optional API key auth for `/chat`
+- In-memory rate limiting per client IP
+- Query embedding cache for repeated questions
+- Docker + docker-compose deployment
+
+## Project Structure
+
+`app/main.py` - FastAPI app and endpoints  
+`app/services/document_loader.py` - PDF/TXT ingestion and cleaning  
+`app/services/chunker.py` - token-window chunking  
+`app/services/embeddings.py` - embedding model wrapper  
+`app/services/vector_store.py` - FAISS index and retrieval  
+`app/services/llm.py` - Groq/HF LLM clients and prompt  
+`app/services/rag_pipeline.py` - end-to-end chat flow  
+`app/ui_gradio.py` - optional web chat UI
+
+## Setup
+
+1. Install dependencies:
+
+```bash
+pip install -r requirements.txt
+```
+
+2. Configure environment:
+
+```bash
+copy .env.example .env
+```
+
+Then set your keys in `.env`:
+- `GROQ_API_KEY` (if using Groq)
+- `HF_API_KEY` (if using Hugging Face)
+- Optional:
+  - `API_KEY` for request auth (send as `x-api-key`)
+  - `CORS_ALLOW_ORIGINS` as comma-separated origins
+  - `RATE_LIMIT_REQUESTS` and `RATE_LIMIT_WINDOW_SECONDS`
+
+3. Add documents:
+- Put your `.pdf` and `.txt` files in `docs/`
+
+## Run API
+
+```bash
+uvicorn app.main:app --host 0.0.0.0 --port 8000
+```
+
+## Endpoints
+
+### `GET /health`
+Returns status and index readiness.
+
+### `POST /chat`
+
+Request:
+```json
+{
+  "message": "What are the key points?",
+  "history": []
+}
+```
+
+Response:
+```json
+{
+  "reply": "Answer based on retrieved context.",
+  "retrieved_chunks": [
+    {
+      "id": "...",
+      "source": "...",
+      "text": "...",
+      "score": 0.83
+    }
+  ]
+}
+```
+
+## Optional UI
+
+Start API first, then:
+
+```bash
+python -m app.ui_gradio
+```
+
+By default, Gradio now runs in direct RAG mode (no localhost API dependency).
+If you set `RAG_API_URL`, it will call that external FastAPI endpoint instead.
+
+## Deployment Notes
+
+- Works as backend for websites (REST API is frontend-agnostic)
+- Persist `data/index/` volume in production
+- Prefer Groq provider for low latency
+- Keep `top_k` small (3-5) for speed and lower prompt tokens
+- Protect `/chat` with `API_KEY` in production
+- Set strict `CORS_ALLOW_ORIGINS` instead of `*`
+
+## Docker Deployment
+
+Build and run:
+
+```bash
+docker compose up --build -d
+```
+
+Health check:
+
+```bash
+curl http://localhost:8000/health
+```
+
+Chat call with API key:
+
+```bash
+curl -X POST http://localhost:8000/chat ^
+  -H "Content-Type: application/json" ^
+  -H "x-api-key: YOUR_API_KEY" ^
+  -d "{\"message\":\"What does the handbook say about leave policy?\",\"history\":[]}"
+```
+
+## Hugging Face Spaces (Recommended: Gradio Space)
+
+Use these settings in your Space:
+- **SDK**: Gradio
+- **App file**: `app.py`
+- **Python version**: 3.10+ (3.11 recommended)
+
+Add Space Secrets:
+- `GROQ_API_KEY` (or `HF_API_KEY`)
+- Optional: `LLM_PROVIDER`, `GROQ_MODEL`, `HF_MODEL`, `TOP_K`
+
+Upload project files (excluding `.env`) and include your knowledge files inside `docs/`.

backup_2026-05-04/app.py

@@ -0,0 +1,6 @@
+import uvicorn
+from app.main import app
+
+# Hugging Face Spaces (sdk: gradio) looks for `app` variable
+if __name__ == "__main__":
+    uvicorn.run("app.main:app", host="0.0.0.0", port=7860)

backup_2026-05-04/app/admin/__init__.py

@@ -0,0 +1 @@
+# app/admin/__init__.py

backup_2026-05-04/app/admin/router.py

@@ -0,0 +1,346 @@
+"""
+app/admin/router.py
+───────────────────
+Secure FastAPI router for the Admin Panel.
+
+Security design:
+  • All /admin/* routes require HTTP Basic Auth.
+  • Credentials are compared using secrets.compare_digest() to prevent
+    timing-based attacks — NOT a simple == comparison.
+  • Wrong credentials always return 401 with WWW-Authenticate header.
+  • Admin routes are completely isolated from the main app and Gradio UI.
+
+Endpoints:
+  GET  /admin                → Serves the premium admin.html SPA
+  GET  /api/admin/sessions   → Returns all session summaries (JSON)
+  GET  /api/admin/sessions/{session_id}  → Returns full session transcript
+  DELETE /api/admin/sessions/{session_id} → Deletes a session
+"""
+
+import secrets
+import logging
+import asyncio
+import time
+import random
+import smtplib
+from email.mime.text import MIMEText
+from email.mime.multipart import MIMEMultipart
+from pathlib import Path
+from typing import Dict
+
+from fastapi import APIRouter, Depends, HTTPException, status
+from fastapi.responses import HTMLResponse, JSONResponse
+from fastapi.security import HTTPBasic, HTTPBasicCredentials
+
+from app.services.session_store import get_all_sessions, get_session, delete_session, _list_json_files, _read_json
+from app.core.config import get_settings
+import pandas as pd
+import io
+from fastapi.responses import HTMLResponse, JSONResponse, StreamingResponse
+
+logger = logging.getLogger(__name__)
+settings = get_settings()
+
+# ── Credentials (stored as constants — in production, move to env vars) ───────
+ADMIN_USERNAME = "martech_admin"
+ADMIN_PASSWORD = "martech_admin_303"
+
+# ── Security scheme ───────────────────────────────────────────────────────────
+security = HTTPBasic()
+
+# ── Router ────────────────────────────────────────────────────────────────────
+admin_router = APIRouter(tags=["admin"])
+
+# ── OTP Store (In-memory for simplicity) ──────────────────────────────────────
+# Format: {username: {"code": "123456", "expires": timestamp}}
+_otp_store: Dict[str, dict] = {}
+OTP_EXPIRY_SECONDS = 300  # 5 minutes
+
+# ── Path to the admin HTML template ──────────────────────────────────────────
+_ADMIN_HTML_PATH = Path(__file__).parent / "templates" / "admin.html"
+
+
+# ── Auth dependency ───────────────────────────────────────────────────────────
+def verify_admin(credentials: HTTPBasicCredentials = Depends(security)) -> str:
+    """
+    Verifies HTTP Basic credentials using constant-time comparison.
+    Raises 401 for any mismatch. Returns the username on success.
+    """
+    correct_username = secrets.compare_digest(
+        credentials.username.encode("utf-8"),
+        ADMIN_USERNAME.encode("utf-8"),
+    )
+    correct_password = secrets.compare_digest(
+        credentials.password.encode("utf-8"),
+        ADMIN_PASSWORD.encode("utf-8"),
+    )
+    if not (correct_username and correct_password):
+        logger.warning(
+            "Admin auth failed for user: '%s'", credentials.username
+        )
+        raise HTTPException(
+            status_code=status.HTTP_401_UNAUTHORIZED,
+            detail="Invalid admin credentials.",
+        )
+    return credentials.username
+
+
+# ── OTP Endpoints ─────────────────────────────────────────────────────────────
+
+from pydantic import BaseModel
+
+class LoginRequest(BaseModel):
+    username: str
+    password: str
+
+class OTPVerifyRequest(BaseModel):
+    username: str
+    password: str
+    code: str
+
+@admin_router.post("/api/admin/request-otp", include_in_schema=False)
+async def request_otp(req: LoginRequest):
+    """
+    Verifies password and generates a 6-digit OTP.
+    Sends the OTP to the configured admin email.
+    """
+    if not (secrets.compare_digest(req.username, ADMIN_USERNAME) and 
+            secrets.compare_digest(req.password, ADMIN_PASSWORD)):
+        raise HTTPException(status_code=401, detail="Invalid credentials.")
+    
+    # Generate 6-digit code
+    code = "".join([str(random.randint(0, 9)) for _ in range(6)])
+    _otp_store[req.username] = {
+        "code": code,
+        "expires": time.time() + OTP_EXPIRY_SECONDS
+    }
+    
+    # Attempt to send email
+    email_sent = False
+    if settings.smtp_user and settings.smtp_pass:
+        try:
+            # Use to_thread to avoid blocking the event loop during SMTP network I/O
+            await asyncio.to_thread(send_otp_email, settings.admin_email, code)
+            email_sent = True
+            logger.info("OTP email sent to %s", settings.admin_email)
+        except Exception as e:
+            logger.error("Failed to send OTP email: %s", e)
+    else:
+        logger.warning("SMTP credentials not configured. OTP will only be in logs.")
+
+    # FALLBACK/LOG: Always log to console so the user is never locked out
+    print("\n" + "="*50)
+    print(f"  ADMIN OTP FOR {req.username.upper()}: {code}")
+    print(f"  SENDING TO: {settings.admin_email} ({'SUCCESS' if email_sent else 'FAILED/SKIPPED'})")
+    print("  EXPIRES IN 5 MINUTES")
+    print("="*50 + "\n")
+    
+    return {
+        "message": "OTP sent successfully.",
+        "email_status": "sent" if email_sent else "logged_to_console_only"
+    }
+
+
+import socket
+
+def send_otp_email(to_email: str, otp_code: str):
+    """Sends a professional OTP email via SMTP. Run in thread."""
+    msg = MIMEMultipart()
+    msg['From'] = settings.smtp_user
+    msg['To'] = to_email
+    msg['Subject'] = f"Your Admin Access Code: {otp_code}"
+
+    body = f"""
+    <html>
+    <body style="font-family: sans-serif; padding: 20px; color: #333;">
+        <h2 style="color: #3b82f6;">Martechsol Admin Panel</h2>
+        <p>Your one-time security code is:</p>
+        <div style="font-size: 32px; font-weight: bold; letter-spacing: 5px; padding: 15px; background: #f3f4f6; border-radius: 8px; display: inline-block; margin: 10px 0;">
+            {otp_code}
+        </div>
+        <p style="color: #666; font-size: 14px;">This code will expire in 5 minutes.</p>
+        <hr style="border: 0; border-top: 1px solid #eee; margin-top: 20px;">
+        <p style="font-size: 12px; color: #999;">If you did not request this code, please secure your account.</p>
+    </body>
+    </html>
+    """
+    msg.attach(MIMEText(body, 'html'))
+
+    # Force IPv4 resolution to avoid "Network unreachable" IPv6 issues
+    try:
+        ais = socket.getaddrinfo(settings.smtp_server, settings.smtp_port, socket.AF_INET)
+        target_ip = ais[0][4][0]
+        logger.info("Resolved %s to IPv4: %s", settings.smtp_server, target_ip)
+    except Exception as e:
+        logger.error("DNS Resolution failed: %s", e)
+        target_ip = settings.smtp_server
+
+    logger.info("Attempting SMTP_SSL connection to %s:%d (via %s)", 
+                settings.smtp_server, settings.smtp_port, target_ip)
+    
+    # Using the IP directly can sometimes bypass DNS/routing quirks
+    with smtplib.SMTP_SSL(target_ip, settings.smtp_port, timeout=15) as server:
+        server.login(settings.smtp_user, settings.smtp_pass)
+        server.send_message(msg)
+
+
+@admin_router.post("/api/admin/verify-otp", include_in_schema=False)
+async def verify_otp(req: OTPVerifyRequest):
+    """Verifies both the password and the OTP code."""
+    # 1. Verify password first
+    if not (secrets.compare_digest(req.username, ADMIN_USERNAME) and 
+            secrets.compare_digest(req.password, ADMIN_PASSWORD)):
+        raise HTTPException(status_code=401, detail="Invalid credentials.")
+    
+    # 2. Verify OTP
+    stored = _otp_store.get(req.username)
+    if not stored:
+        raise HTTPException(status_code=400, detail="No OTP requested for this user.")
+    
+    if time.time() > stored["expires"]:
+        del _otp_store[req.username]
+        raise HTTPException(status_code=400, detail="OTP has expired. Please request a new one.")
+    
+    if not secrets.compare_digest(req.code, stored["code"]):
+        raise HTTPException(status_code=401, detail="Invalid OTP code.")
+    
+    # Success — clear OTP and return
+    del _otp_store[req.username]
+    return {"message": "OTP verified."}
+
+
+# ── Routes ────────────────────────────────────────────────────────────────────
+
+@admin_router.get("/admin", response_class=HTMLResponse, include_in_schema=False)
+async def admin_panel():
+    """Serves the admin panel SPA."""
+    try:
+        html_content = _ADMIN_HTML_PATH.read_text(encoding="utf-8")
+        return HTMLResponse(content=html_content, status_code=200)
+    except FileNotFoundError:
+        logger.error("admin.html template not found at %s", _ADMIN_HTML_PATH)
+        raise HTTPException(
+            status_code=500,
+            detail="Admin panel template is missing. Please redeploy.",
+        )
+
+
+@admin_router.get("/api/admin/sessions", include_in_schema=False)
+async def list_sessions(username: str = Depends(verify_admin)):
+    """Returns all session summaries sorted by most recent activity."""
+    sessions = await get_all_sessions()
+    return JSONResponse(content={"sessions": sessions, "total": len(sessions)})
+
+
+@admin_router.get("/api/admin/sessions/{session_id}", include_in_schema=False)
+async def get_session_detail(
+    session_id: str, username: str = Depends(verify_admin)
+):
+    """Returns the full Q&A transcript for a specific session."""
+    # Basic input sanitisation — session_id should only be a UUID-like string
+    if not session_id.replace("-", "").replace("_", "").isalnum():
+        raise HTTPException(status_code=400, detail="Invalid session ID format.")
+
+    data = await get_session(session_id)
+    if not data:
+        raise HTTPException(
+            status_code=404,
+            detail=f"Session '{session_id}' not found.",
+        )
+    return JSONResponse(content=data)
+
+
+@admin_router.delete("/api/admin/sessions/{session_id}", include_in_schema=False)
+async def remove_session(
+    session_id: str, username: str = Depends(verify_admin)
+):
+    """Deletes a session file permanently."""
+    if not session_id.replace("-", "").replace("_", "").isalnum():
+        raise HTTPException(status_code=400, detail="Invalid session ID format.")
+
+    success = await delete_session(session_id)
+    if not success:
+        raise HTTPException(status_code=500, detail="Failed to delete session.")
+    return JSONResponse(content={"deleted": session_id})
+
+
+# ── Export Endpoints ─────────────────────────────────────────────────────────
+
+@admin_router.get("/api/admin/export/session/{session_id}", include_in_schema=False)
+async def export_session(
+    session_id: str, format: str = "excel", username: str = Depends(verify_admin)
+):
+    """Exports a single session's transcript in Excel or JSON format."""
+    data = await get_session(session_id)
+    if not data:
+        raise HTTPException(status_code=404, detail="Session not found.")
+
+    messages = data.get("messages", [])
+    export_data = []
+    for msg in messages:
+        export_data.append({
+            "Timestamp": msg.get("timestamp", ""),
+            "Question": msg.get("question", ""),
+            "Answer": msg.get("answer", "")
+        })
+
+    if format.lower() == "json":
+        return JSONResponse(
+            content=export_data,
+            headers={"Content-Disposition": f"attachment; filename=session_{session_id}.json"}
+        )
+    
+    # Excel Export
+    df = pd.DataFrame(export_data)
+    output = io.BytesIO()
+    with pd.ExcelWriter(output, engine='openpyxl') as writer:
+        df.to_excel(writer, index=False, sheet_name='Transcript')
+    
+    output.seek(0)
+    return StreamingResponse(
+        output,
+        media_type="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet",
+        headers={"Content-Disposition": f"attachment; filename=session_{session_id}.xlsx"}
+    )
+
+
+@admin_router.get("/api/admin/export/all", include_in_schema=False)
+async def export_all_sessions(
+    format: str = "excel", username: str = Depends(verify_admin)
+):
+    """Exports all sessions' transcripts in a single Excel or JSON file."""
+    files = await asyncio.to_thread(_list_json_files)
+    all_messages = []
+    
+    for fpath in files:
+        try:
+            data = await asyncio.to_thread(_read_json, fpath)
+            session_id = data.get("session_id", fpath.stem)
+            for msg in data.get("messages", []):
+                all_messages.append({
+                    "Session ID": session_id,
+                    "Timestamp": msg.get("timestamp", ""),
+                    "Question": msg.get("question", ""),
+                    "Answer": msg.get("answer", "")
+                })
+        except Exception as e:
+            logger.warning("Failed to read %s for export: %s", fpath, e)
+
+    if format.lower() == "json":
+        return JSONResponse(
+            content=all_messages,
+            headers={"Content-Disposition": "attachment; filename=all_chats_export.json"}
+        )
+
+    # Excel Export
+    df = pd.DataFrame(all_messages)
+    output = io.BytesIO()
+    with pd.ExcelWriter(output, engine='openpyxl') as writer:
+        df.to_excel(writer, index=False, sheet_name='All Chats')
+    
+    output.seek(0)
+    return StreamingResponse(
+        output,
+        media_type="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet",
+        headers={"Content-Disposition": "attachment; filename=all_chats_export.xlsx"}
+    )

backup_2026-05-04/app/admin/templates/admin.html

@@ -0,0 +1,1143 @@
+<!DOCTYPE html>
+<html lang="en">
+
+<head>
+  <meta charset="UTF-8" />
+  <meta name="viewport" content="width=device-width,initial-scale=1.0" />
+  <title>Martechsol — Admin Panel</title>
+  <link rel="preconnect" href="https://fonts.googleapis.com" />
+  <link href="https://fonts.googleapis.com/css2?family=Inter:wght@300;400;500;600;700&display=swap" rel="stylesheet" />
+  <style>
+    *,
+    *::before,
+    *::after {
+      box-sizing: border-box;
+      margin: 0;
+      padding: 0
+    }
+
+    :root {
+      --bg: #0a0d14;
+      --surface: #111827;
+      --surface2: #1a2235;
+      --surface3: #1f2a3d;
+      --border: #1e2d45;
+      --accent: #3b82f6;
+      --accent2: #6366f1;
+      --green: #10b981;
+      --red: #ef4444;
+      --yellow: #f59e0b;
+      --text: #f1f5f9;
+      --text2: #94a3b8;
+      --text3: #64748b;
+      --radius: 12px;
+      --shadow: 0 4px 24px rgba(0, 0, 0, .4);
+    }
+
+    html,
+    body {
+      height: 100%;
+      font-family: 'Inter', sans-serif;
+      background: var(--bg);
+      color: var(--text);
+      overflow: hidden
+    }
+
+    /* ── Login Screen ── */
+    #login-screen {
+      position: fixed;
+      inset: 0;
+      display: flex;
+      align-items: center;
+      justify-content: center;
+      background: radial-gradient(ellipse at 50% 0%, #1a2a4a 0%, var(--bg) 70%);
+      z-index: 9999;
+    }
+
+    .login-card {
+      width: 380px;
+      background: var(--surface);
+      border: 1px solid var(--border);
+      border-radius: 20px;
+      padding: 44px 40px;
+      box-shadow: var(--shadow);
+      animation: fadeUp .5s ease;
+    }
+
+    .login-logo {
+      text-align: center;
+      margin-bottom: 28px
+    }
+
+    .login-logo svg {
+      width: 52px;
+      height: 52px
+    }
+
+    .login-logo h1 {
+      font-size: 22px;
+      font-weight: 700;
+      margin-top: 12px;
+      background: linear-gradient(135deg, var(--accent), var(--accent2));
+      -webkit-background-clip: text;
+      -webkit-text-fill-color: transparent
+    }
+
+    .login-logo p {
+      font-size: 13px;
+      color: var(--text3);
+      margin-top: 4px
+    }
+
+    .form-group {
+      margin-bottom: 16px
+    }
+
+    .form-group label {
+      display: block;
+      font-size: 12px;
+      font-weight: 600;
+      color: var(--text2);
+      text-transform: uppercase;
+      letter-spacing: .06em;
+      margin-bottom: 6px
+    }
+
+    .form-group input {
+      width: 100%;
+      padding: 11px 14px;
+      background: var(--surface2);
+      border: 1px solid var(--border);
+      border-radius: 8px;
+      color: var(--text);
+      font-size: 14px;
+      font-family: inherit;
+      outline: none;
+      transition: border-color .2s;
+    }
+
+    .form-group input:focus {
+      border-color: var(--accent)
+    }
+
+    .btn-login {
+      width: 100%;
+      padding: 12px;
+      border: none;
+      border-radius: 8px;
+      cursor: pointer;
+      font-size: 14px;
+      font-weight: 600;
+      font-family: inherit;
+      background: linear-gradient(135deg, var(--accent), var(--accent2));
+      color: #fff;
+      transition: opacity .2s, transform .15s;
+      margin-top: 4px;
+    }
+
+    .btn-login:hover {
+      opacity: .9;
+      transform: translateY(-1px)
+    }
+
+    .login-error {
+      display: none;
+      background: rgba(239, 68, 68, .12);
+      border: 1px solid rgba(239, 68, 68, .3);
+      border-radius: 8px;
+      padding: 10px 14px;
+      font-size: 13px;
+      color: #fca5a5;
+      margin-top: 14px;
+    }
+
+    /* ── App Shell ── */
+    #app {
+      display: none;
+      height: 100vh;
+      display: grid;
+      grid-template-columns: 280px 1fr;
+      grid-template-rows: 60px 1fr
+    }
+
+    .topbar {
+      grid-column: 1/-1;
+      display: flex;
+      align-items: center;
+      justify-content: space-between;
+      padding: 0 24px;
+      background: var(--surface);
+      border-bottom: 1px solid var(--border);
+    }
+
+    .topbar-brand {
+      display: flex;
+      align-items: center;
+      gap: 10px;
+      font-weight: 700;
+      font-size: 16px
+    }
+
+    .topbar-brand .dot {
+      width: 8px;
+      height: 8px;
+      background: var(--green);
+      border-radius: 50%;
+      box-shadow: 0 0 8px var(--green);
+      animation: pulse 2s infinite
+    }
+
+    .topbar-right {
+      display: flex;
+      align-items: center;
+      gap: 14px
+    }
+
+    .badge {
+      font-size: 11px;
+      padding: 3px 10px;
+      border-radius: 20px;
+      background: rgba(59, 130, 246, .15);
+      color: var(--accent);
+      border: 1px solid rgba(59, 130, 246, .25)
+    }
+
+    .btn-logout {
+      padding: 7px 16px;
+      border: 1px solid var(--border);
+      border-radius: 8px;
+      background: transparent;
+      color: var(--text2);
+      font-size: 13px;
+      font-family: inherit;
+      cursor: pointer;
+      transition: all .2s;
+    }
+
+    .btn-logout:hover {
+      border-color: var(--red);
+      color: var(--red)
+    }
+
+    /* ── Sidebar ── */
+    .sidebar {
+      background: var(--surface);
+      border-right: 1px solid var(--border);
+      overflow: hidden;
+      display: flex;
+      flex-direction: column;
+    }
+
+    .sidebar-head {
+      padding: 16px 20px;
+      border-bottom: 1px solid var(--border);
+    }
+
+    .sidebar-head h2 {
+      font-size: 12px;
+      font-weight: 600;
+      text-transform: uppercase;
+      letter-spacing: .08em;
+      color: var(--text3)
+    }
+
+    .sidebar-stats {
+      display: flex;
+      gap: 16px;
+      margin-top: 10px
+    }
+
+    .stat {
+      text-align: center;
+      flex: 1;
+      background: var(--surface2);
+      border-radius: 8px;
+      padding: 8px 4px
+    }
+
+    .stat-val {
+      font-size: 20px;
+      font-weight: 700;
+      color: var(--accent)
+    }
+
+    .stat-lbl {
+      font-size: 10px;
+      color: var(--text3);
+      margin-top: 1px
+    }
+
+    .sidebar-actions {
+      padding: 12px 16px;
+      display: flex;
+      gap: 8px;
+      border-bottom: 1px solid var(--border)
+    }
+
+    .btn-export {
+      flex: 1;
+      padding: 8px;
+      border: 1px solid var(--border);
+      border-radius: 8px;
+      background: var(--surface2);
+      color: var(--text2);
+      font-size: 12px;
+      font-weight: 600;
+      cursor: pointer;
+      display: flex;
+      align-items: center;
+      justify-content: center;
+      gap: 6px;
+      transition: all .2s;
+    }
+
+    .btn-export:hover {
+      border-color: var(--accent);
+      color: var(--accent);
+      background: rgba(59, 130, 246, 0.05)
+    }
+
+    .export-dropdown {
+      position: relative;
+      display: inline-block;
+      flex: 1
+    }
+
+    .export-menu {
+      position: absolute;
+      top: 100%;
+      left: 0;
+      right: 0;
+      background: var(--surface3);
+      border: 1px solid var(--border);
+      border-radius: 8px;
+      margin-top: 4px;
+      display: none;
+      z-index: 100;
+      box-shadow: var(--shadow);
+      overflow: hidden;
+    }
+
+    .export-menu button {
+      width: 100%;
+      padding: 10px;
+      border: none;
+      background: none;
+      color: var(--text2);
+      font-size: 12px;
+      text-align: left;
+      cursor: pointer;
+      transition: all .2s;
+    }
+
+    .export-menu button:hover {
+      background: var(--surface2);
+      color: var(--text)
+    }
+
+    .export-dropdown:hover .export-menu {
+      display: block
+    }
+
+    .search-wrap {
+      padding: 12px 16px;
+      border-bottom: 1px solid var(--border)
+    }
+
+    .search-wrap input {
+      width: 100%;
+      padding: 8px 12px;
+      background: var(--surface2);
+      border: 1px solid var(--border);
+      border-radius: 8px;
+      color: var(--text);
+      font-size: 13px;
+      font-family: inherit;
+      outline: none;
+    }
+
+    .search-wrap input:focus {
+      border-color: var(--accent)
+    }
+
+    .session-list {
+      flex: 1;
+      overflow-y: auto;
+      padding: 8px
+    }
+
+    .session-list::-webkit-scrollbar {
+      width: 4px
+    }
+
+    .session-list::-webkit-scrollbar-track {
+      background: transparent
+    }
+
+    .session-list::-webkit-scrollbar-thumb {
+      background: var(--border);
+      border-radius: 4px
+    }
+
+    .session-item {
+      padding: 12px 14px;
+      border-radius: 10px;
+      cursor: pointer;
+      margin-bottom: 4px;
+      border: 1px solid transparent;
+      transition: all .2s;
+    }
+
+    .session-item:hover {
+      background: var(--surface2);
+      border-color: var(--border)
+    }
+
+    .session-item.active {
+      background: rgba(59, 130, 246, .1);
+      border-color: rgba(59, 130, 246, .35)
+    }
+
+    .session-item-id {
+      font-size: 12px;
+      font-weight: 600;
+      color: var(--text);
+      white-space: nowrap;
+      overflow: hidden;
+      text-overflow: ellipsis
+    }
+
+    .session-item-meta {
+      display: flex;
+      justify-content: space-between;
+      margin-top: 4px
+    }
+
+    .session-item-time {
+      font-size: 11px;
+      color: var(--text3)
+    }
+
+    .session-item-count {
+      font-size: 11px;
+      background: var(--surface3);
+      padding: 1px 7px;
+      border-radius: 20px;
+      color: var(--text2)
+    }
+
+    .no-sessions {
+      text-align: center;
+      padding: 40px 20px;
+      color: var(--text3);
+      font-size: 13px
+    }
+
+    /* ── Main Content ── */
+    .main {
+      overflow: hidden;
+      display: flex;
+      flex-direction: column;
+      background: var(--bg)
+    }
+
+    .main-placeholder {
+      flex: 1;
+      display: flex;
+      flex-direction: column;
+      align-items: center;
+      justify-content: center;
+      color: var(--text3);
+      gap: 14px;
+    }
+
+    .main-placeholder svg {
+      width: 56px;
+      height: 56px;
+      opacity: .3
+    }
+
+    .main-placeholder p {
+      font-size: 14px
+    }
+
+    .chat-view {
+      flex: 1;
+      display: flex;
+      flex-direction: column;
+      overflow: hidden
+    }
+
+    .chat-header {
+      padding: 16px 24px;
+      background: var(--surface);
+      border-bottom: 1px solid var(--border);
+      display: flex;
+      align-items: center;
+      justify-content: space-between;
+    }
+
+    .chat-header-info h3 {
+      font-size: 14px;
+      font-weight: 600
+    }
+
+    .chat-header-info p {
+      font-size: 12px;
+      color: var(--text3);
+      margin-top: 2px
+    }
+
+    .chat-header-actions {
+      display: flex;
+      gap: 8px
+    }
+
+    .btn-del {
+      padding: 6px 14px;
+      border: 1px solid rgba(239, 68, 68, .3);
+      border-radius: 8px;
+      background: rgba(239, 68, 68, .08);
+      color: #fca5a5;
+      font-size: 12px;
+      font-family: inherit;
+      cursor: pointer;
+      transition: all .2s;
+    }
+
+    .btn-del:hover {
+      background: rgba(239, 68, 68, .2)
+    }
+
+    .messages-area {
+      flex: 1;
+      overflow-y: auto;
+      padding: 24px;
+      display: flex;
+      flex-direction: column;
+      gap: 16px
+    }
+
+    .messages-area::-webkit-scrollbar {
+      width: 4px
+    }
+
+    .messages-area::-webkit-scrollbar-thumb {
+      background: var(--border);
+      border-radius: 4px
+    }
+
+    .msg-block {
+      display: flex;
+      flex-direction: column;
+      gap: 8px
+    }
+
+    .msg-label {
+      font-size: 10px;
+      font-weight: 700;
+      text-transform: uppercase;
+      letter-spacing: .08em;
+      display: flex;
+      align-items: center;
+      gap: 6px
+    }
+
+    .msg-label.q {
+      color: var(--accent)
+    }
+
+    .msg-label.a {
+      color: var(--green)
+    }
+
+    .msg-bubble {
+      padding: 13px 16px;
+      border-radius: 10px;
+      font-size: 14px;
+      line-height: 1.65;
+      white-space: pre-wrap;
+      word-break: break-word;
+      max-width: 100%;
+    }
+
+    .msg-bubble.q {
+      background: rgba(59, 130, 246, .1);
+      border: 1px solid rgba(59, 130, 246, .2);
+      color: var(--text)
+    }
+
+    .msg-bubble.a {
+      background: rgba(16, 185, 129, .08);
+      border: 1px solid rgba(16, 185, 129, .2);
+      color: var(--text)
+    }
+
+    .msg-ts {
+      font-size: 11px;
+      color: var(--text3);
+      margin-top: 2px
+    }
+
+    .msg-num {
+      font-size: 11px;
+      background: var(--surface2);
+      padding: 1px 8px;
+      border-radius: 20px;
+      color: var(--text3)
+    }
+
+    .spinner {
+      width: 32px;
+      height: 32px;
+      border: 3px solid var(--border);
+      border-top-color: var(--accent);
+      border-radius: 50%;
+      animation: spin .7s linear infinite;
+      margin: auto;
+    }
+
+    .toast {
+      position: fixed;
+      bottom: 24px;
+      right: 24px;
+      padding: 12px 20px;
+      background: var(--surface2);
+      border: 1px solid var(--border);
+      border-radius: 10px;
+      font-size: 13px;
+      color: var(--text);
+      box-shadow: var(--shadow);
+      transform: translateY(20px);
+      opacity: 0;
+      transition: all .3s;
+      pointer-events: none;
+      z-index: 9998;
+    }
+
+    .toast.show {
+      transform: translateY(0);
+      opacity: 1
+    }
+
+    .toast.success {
+      border-color: rgba(16, 185, 129, .4);
+      color: #6ee7b7
+    }
+
+    .toast.error {
+      border-color: rgba(239, 68, 68, .4);
+      color: #fca5a5
+    }
+
+    /* ── Animations ── */
+    @keyframes fadeUp {
+      from {
+        opacity: 0;
+        transform: translateY(18px)
+      }
+
+      to {
+        opacity: 1;
+        transform: translateY(0)
+      }
+    }
+
+    @keyframes pulse {
+
+      0%,
+      100% {
+        opacity: 1
+      }
+
+      50% {
+        opacity: .4
+      }
+    }
+
+    @keyframes spin {
+      to {
+        transform: rotate(360deg)
+      }
+    }
+  </style>
+</head>
+
+<body>
+
+  <!-- LOGIN SCREEN -->
+  <div id="login-screen">
+    <div class="login-card">
+      <div class="login-logo">
+        <svg viewBox="0 0 52 52" fill="none">
+          <rect width="52" height="52" rx="14" fill="url(#lg)" />
+          <path d="M16 26h20M26 16v20" stroke="#fff" stroke-width="2.5" stroke-linecap="round" />
+          <defs>
+            <linearGradient id="lg" x1="0" y1="0" x2="52" y2="52">
+              <stop stop-color="#3b82f6" />
+              <stop offset="1" stop-color="#6366f1" />
+            </linearGradient>
+          </defs>
+        </svg>
+        <h1>Martechsol Admin</h1>
+        <p>Secure Chat Analytics Dashboard</p>
+      </div>
+      <!-- Stage 1: Username & Password -->
+      <div id="login-stage-1">
+        <div class="form-group">
+          <label>Username</label>
+          <input type="text" id="inp-user" placeholder="Enter username" autocomplete="username" />
+        </div>
+        <div class="form-group">
+          <label>Password</label>
+          <input type="password" id="inp-pass" placeholder="Enter password" autocomplete="current-password" />
+        </div>
+        <button class="btn-login" id="btn-login">Sign In</button>
+      </div>
+
+      <!-- Stage 2: OTP (Hidden by default) -->
+      <div id="login-stage-2" style="display:none">
+        <div class="form-group">
+          <label>One-Time Password (OTP)</label>
+          <input type="text" id="inp-otp" placeholder="6-digit code" maxlength="6"
+            style="text-align:center;letter-spacing:0.5em;font-size:18px;font-weight:700" />
+          <p id="otp-hint" style="font-size:11px;color:var(--text3);margin-top:8px;text-align:center">Code sent to your
+            email</p>
+        </div>
+        <button class="btn-login" id="btn-verify">Verify & Enter</button>
+        <button class="btn-logout" id="btn-back" style="width:100%;margin-top:10px;border:none">Back to Login</button>
+      </div>
+
+      <div class="login-error" id="login-error">Invalid credentials. Please try again.</div>
+    </div>
+  </div>
+
+  <!-- APP SHELL (hidden until login) -->
+  <div id="app" style="display:none">
+    <!-- Topbar -->
+    <header class="topbar">
+      <div class="topbar-brand">
+        <div class="dot"></div>
+        Martechsol Admin Panel
+      </div>
+      <div class="topbar-right">
+        <span class="badge" id="total-badge">Loading…</span>
+        <button class="btn-logout" id="btn-logout">Sign Out</button>
+      </div>
+    </header>
+
+    <!-- Sidebar -->
+    <aside class="sidebar">
+      <div class="sidebar-head">
+        <h2>Sessions</h2>
+        <div class="sidebar-stats">
+          <div class="stat">
+            <div class="stat-val" id="stat-total">—</div>
+            <div class="stat-lbl">Total</div>
+          </div>
+          <div class="stat">
+            <div class="stat-val" id="stat-msgs">—</div>
+            <div class="stat-lbl">Messages</div>
+          </div>
+          <div class="stat">
+            <div class="stat-val" id="stat-today">—</div>
+            <div class="stat-lbl">Today</div>
+          </div>
+        </div>
+      </div>
+      <div class="sidebar-actions">
+        <div class="export-dropdown">
+          <button class="btn-export">
+            <svg width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2">
+              <path d="M21 15v4a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2v-4M7 10l5 5 5-5M12 15V3" />
+            </svg>
+            Export All
+          </button>
+          <div class="export-menu">
+            <button id="btn-export-all-excel">Excel (.xlsx)</button>
+            <button id="btn-export-all-json">JSON (.json)</button>
+          </div>
+        </div>
+      </div>
+      <div class="search-wrap">
+        <input type="text" id="search-inp" placeholder="Search sessions…" />
+      </div>
+      <div class="session-list" id="session-list">
+        <div class="no-sessions">Loading sessions…</div>
+      </div>
+    </aside>
+
+    <!-- Main -->
+    <main class="main" id="main-area">
+      <div class="main-placeholder" id="placeholder">
+        <svg viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="1.5">
+          <path
+            d="M8 12h.01M12 12h.01M16 12h.01M21 12c0 4.418-4.03 8-9 8a9.863 9.863 0 01-4.255-.949L3 20l1.395-3.72C3.512 15.042 3 13.574 3 12c0-4.418 4.03-8 9-8s9 3.582 9 8z"
+            stroke-linecap="round" stroke-linejoin="round" />
+        </svg>
+        <p>Select a session from the sidebar to view the transcript</p>
+      </div>
+      <div class="chat-view" id="chat-view" style="display:none">
+        <div class="chat-header">
+          <div class="chat-header-info">
+            <h3 id="view-session-id">Session ID</h3>
+            <p id="view-session-user" style="font-weight:600;color:var(--accent);margin-top:2px"></p>
+            <p id="view-session-meta">Loading…</p>
+          </div>
+          <div class="chat-header-actions">
+            <div class="export-dropdown">
+              <button class="btn-export" style="padding: 6px 12px;">
+                <svg width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2">
+                  <path d="M21 15v4a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2v-4M7 10l5 5 5-5M12 15V3" />
+                </svg>
+                Export Session
+              </button>
+              <div class="export-menu" style="right:0;left:auto;min-width:120px">
+                <button id="btn-export-session-excel">Excel (.xlsx)</button>
+                <button id="btn-export-session-json">JSON (.json)</button>
+              </div>
+            </div>
+            <button class="btn-del" id="btn-delete-session">Delete Session</button>
+          </div>
+        </div>
+        <div class="messages-area" id="messages-area"></div>
+      </div>
+    </main>
+  </div>
+
+  <div class="toast" id="toast"></div>
+
+  <script>
+    (function () {
+      const CREDS = { user: 'martech_admin', pass: 'martech_admin_303' };
+      let _creds = null;
+      let _allSessions = [];
+      let _activeId = null;
+
+      const STORAGE_KEY = 'martech_admin_creds';
+
+      // ── Helpers ──────────────────────────────────────────────
+      function $(id) { return document.getElementById(id) }
+      function authHeader() { return 'Basic ' + btoa(_creds.user + ':' + _creds.pass) }
+
+      function showToast(msg, type = '') {
+        const t = $('toast');
+        t.textContent = msg; t.className = 'toast ' + (type || '');
+        t.classList.add('show');
+        setTimeout(() => t.classList.remove('show'), 3000);
+      }
+
+      function fmtDate(iso) {
+        if (!iso) return '—';
+        const d = new Date(iso);
+        return d.toLocaleDateString() + ' ' + d.toLocaleTimeString(undefined, { hour: '2-digit', minute: '2-digit' });
+      }
+
+      function shortId(id) {
+        if (!id) return '—';
+        return id.length > 16 ? id.slice(0, 8) + '…' + id.slice(-6) : id;
+      }
+
+      function todayCount(sessions) {
+        const today = new Date().toDateString();
+        return sessions.filter(s => {
+          try { return new Date(s.created_at).toDateString() === today } catch { return false }
+        }).length;
+      }
+
+      // ── Login ─────────────────────────────────────────────────
+      async function doLogin() {
+        const u = $('inp-user').value.trim();
+        const p = $('inp-pass').value;
+        if (!u || !p) return;
+
+        $('btn-login').textContent = 'Authenticating…';
+        $('btn-login').disabled = true;
+        $('login-error').style.display = 'none';
+
+        try {
+          const r = await fetch('/api/admin/request-otp', {
+            method: 'POST',
+            headers: { 'Content-Type': 'application/json' },
+            body: JSON.stringify({ username: u, password: p })
+          });
+
+          if (r.ok) {
+            const data = await r.json();
+            // Switch to OTP stage
+            $('login-stage-1').style.display = 'none';
+            $('login-stage-2').style.display = 'block';
+            if (data.email_status === 'logged_to_console_only') {
+              $('otp-hint').textContent = 'SMTP not configured. Check server logs.';
+              $('otp-hint').style.color = 'var(--yellow)';
+            } else {
+              $('otp-hint').textContent = 'Code sent to your registered email.';
+              $('otp-hint').style.color = 'var(--text3)';
+            }
+            $('inp-otp').focus();
+          } else {
+            const err = await r.json();
+            $('login-error').textContent = err.detail || 'Login failed.';
+            $('login-error').style.display = 'block';
+          }
+        } catch (e) {
+          $('login-error').textContent = 'Network error: ' + e.message;
+          $('login-error').style.display = 'block';
+        } finally {
+          $('btn-login').textContent = 'Sign In';
+          $('btn-login').disabled = false;
+        }
+      }
+
+      async function doVerifyOtp() {
+        const u = $('inp-user').value.trim();
+        const p = $('inp-pass').value;
+        const otp = $('inp-otp').value.trim();
+        if (!otp) return;
+
+        $('btn-verify').textContent = 'Verifying…';
+        $('btn-verify').disabled = true;
+        $('login-error').style.display = 'none';
+
+        try {
+          const r = await fetch('/api/admin/verify-otp', {
+            method: 'POST',
+            headers: { 'Content-Type': 'application/json' },
+            body: JSON.stringify({ username: u, password: p, code: otp })
+          });
+
+          if (r.ok) {
+            _creds = { user: u, pass: p, otp_verified: true };
+            localStorage.setItem(STORAGE_KEY, JSON.stringify(_creds));
+            $('login-screen').style.display = 'none';
+            $('app').style.display = 'grid';
+            loadSessions();
+            showToast('Login successful', 'success');
+          } else {
+            const err = await r.json();
+            $('login-error').textContent = err.detail || 'Invalid OTP.';
+            $('login-error').style.display = 'block';
+            $('inp-otp').value = '';
+          }
+        } catch (e) {
+          $('login-error').textContent = 'Network error: ' + e.message;
+          $('login-error').style.display = 'block';
+        } finally {
+          $('btn-verify').textContent = 'Verify & Enter';
+          $('btn-verify').disabled = false;
+        }
+      }
+
+      $('btn-login').addEventListener('click', doLogin);
+      $('btn-verify').addEventListener('click', doVerifyOtp);
+      $('btn-back').addEventListener('click', () => {
+        $('login-stage-2').style.display = 'none';
+        $('login-stage-1').style.display = 'block';
+        $('login-error').style.display = 'none';
+        $('inp-otp').value = '';
+      });
+
+      [$('inp-user'), $('inp-pass')].forEach(el => el.addEventListener('keydown', e => { if (e.key === 'Enter') doLogin() }));
+      $('inp-otp').addEventListener('keydown', e => { if (e.key === 'Enter') doVerifyOtp() });
+
+      $('btn-logout').addEventListener('click', () => {
+        _creds = null; _allSessions = []; _activeId = null;
+        localStorage.removeItem(STORAGE_KEY);
+        $('app').style.display = 'none';
+        $('login-screen').style.display = 'flex';
+        $('login-stage-2').style.display = 'none';
+        $('login-stage-1').style.display = 'block';
+        $('inp-pass').value = '';
+        $('inp-otp').value = '';
+        $('login-error').style.display = 'none';
+      });
+
+      // ── Auto-Login ────────────────────────────────────────────
+      (function init() {
+        const stored = localStorage.getItem(STORAGE_KEY);
+        if (stored) {
+          try {
+            const parsed = JSON.parse(stored);
+            if (parsed.user === CREDS.user && parsed.pass === CREDS.pass && parsed.otp_verified) {
+              _creds = parsed;
+              $('login-screen').style.display = 'none';
+              $('app').style.display = 'grid';
+              loadSessions();
+            } else {
+              // Force re-login if OTP was not verified
+              localStorage.removeItem(STORAGE_KEY);
+            }
+          } catch (e) {
+            localStorage.removeItem(STORAGE_KEY);
+          }
+        }
+      })();
+
+      // ── Sessions list ─────────────────────────────────────────
+      async function loadSessions() {
+        $('session-list').innerHTML = '<div class="no-sessions"><div class="spinner"></div></div>';
+        try {
+          const r = await fetch('/api/admin/sessions', { headers: { Authorization: authHeader() } });
+          if (!r.ok) throw new Error('HTTP ' + r.status);
+          const data = await r.json();
+          _allSessions = data.sessions || [];
+          renderSidebar(_allSessions);
+          updateStats(_allSessions);
+        } catch (e) {
+          $('session-list').innerHTML = '<div class="no-sessions">Failed to load sessions.</div>';
+          showToast('Could not fetch sessions: ' + e.message, 'error');
+        }
+      }
+
+      function updateStats(sessions) {
+        const totalMsgs = sessions.reduce((a, s) => a + (s.message_count || 0), 0);
+        $('stat-total').textContent = sessions.length;
+        $('stat-msgs').textContent = totalMsgs;
+        $('stat-today').textContent = todayCount(sessions);
+        $('total-badge').textContent = sessions.length + ' Sessions';
+      }
+
+      function renderSidebar(sessions) {
+        if (!sessions.length) {
+          $('session-list').innerHTML = '<div class="no-sessions">No sessions yet.</div>';
+          return;
+        }
+        $('session-list').innerHTML = sessions.map(s => `
+      <div class="session-item${s.session_id === _activeId ? ' active' : ''}"
+           data-id="${s.session_id}">
+        <div class="session-item-id" title="${s.user_name || s.session_id}">${s.user_name || shortId(s.session_id)}</div>
+        <div class="session-item-meta">
+          <span class="session-item-time">${fmtDate(s.last_active)}</span>
+          <span class="session-item-count">${s.message_count || 0} msg${s.message_count !== 1 ? 's' : ''}</span>
+        </div>
+      </div>
+    `).join('');
+        document.querySelectorAll('.session-item').forEach(el => {
+          el.addEventListener('click', () => openSession(el.dataset.id));
+        });
+      }
+
+      $('search-inp').addEventListener('input', e => {
+        const q = e.target.value.toLowerCase();
+        const filtered = _allSessions.filter(s => s.session_id.toLowerCase().includes(q));
+        renderSidebar(filtered);
+      });
+
+      // ── Session detail ────────────────────────────────────────
+      async function openSession(id) {
+        _activeId = id;
+        document.querySelectorAll('.session-item').forEach(el => {
+          el.classList.toggle('active', el.dataset.id === id);
+        });
+        $('placeholder').style.display = 'none';
+        $('chat-view').style.display = 'flex';
+        $('view-session-id').textContent = shortId(id);
+        $('view-session-user').textContent = '';
+        $('view-session-meta').textContent = 'Loading…';
+        $('messages-area').innerHTML = '<div class="spinner" style="margin-top:60px"></div>';
+
+        try {
+          const r = await fetch('/api/admin/sessions/' + encodeURIComponent(id),
+            { headers: { Authorization: authHeader() } });
+          if (!r.ok) throw new Error('HTTP ' + r.status);
+          const data = await r.json();
+          renderSession(data);
+        } catch (e) {
+          $('messages-area').innerHTML = '<div style="color:var(--red);padding:20px">Failed to load session: ' + e.message + '</div>';
+        }
+      }
+
+      function renderSession(data) {
+        $('view-session-user').textContent = data.user_name || 'Guest User';
+        $('view-session-meta').textContent =
+          'Created: ' + fmtDate(data.created_at) + '  |  Last active: ' + fmtDate(data.last_active) +
+          '  |  ' + (data.message_count || 0) + ' messages';
+
+        const msgs = data.messages || [];
+        if (!msgs.length) {
+          $('messages-area').innerHTML = '<div style="color:var(--text3);text-align:center;margin-top:40px">No messages in this session.</div>';
+          return;
+        }
+        $('messages-area').innerHTML = msgs.map(m => `
+      <div class="msg-block">
+        <div style="display:flex;align-items:center;gap:8px">
+          <span class="msg-label q">
+            <svg width="12" height="12" viewBox="0 0 24 24" fill="currentColor"><path d="M12 2C6.48 2 2 6.48 2 12s4.48 10 10 10 10-4.48 10-10S17.52 2 12 2zm0 3c1.66 0 3 1.34 3 3s-1.34 3-3 3-3-1.34-3-3 1.34-3 3-3zm0 14.2c-2.5 0-4.71-1.28-6-3.22.03-1.99 4-3.08 6-3.08 1.99 0 5.97 1.09 6 3.08-1.29 1.94-3.5 3.22-6 3.22z"/></svg>
+            User Question
+          </span>
+          <span class="msg-num">#${m.id || '—'}</span>
+          <span class="msg-ts">${fmtDate(m.timestamp)}</span>
+        </div>
+        <div class="msg-bubble q">${escHtml(m.question)}</div>
+        <div class="msg-label a" style="margin-top:6px">
+          <svg width="12" height="12" viewBox="0 0 24 24" fill="currentColor"><path d="M20 2H4c-1.1 0-2 .9-2 2v18l4-4h14c1.1 0 2-.9 2-2V4c0-1.1-.9-2-2-2z"/></svg>
+          Assistant Answer
+        </div>
+        <div class="msg-bubble a">${escHtml(m.answer)}</div>
+      </div>
+    `).join('');
+      }
+
+      function escHtml(str) {
+        return String(str || '')
+          .replace(/&/g, '&amp;').replace(/</g, '&lt;').replace(/>/g, '&gt;')
+          .replace(/"/g, '&quot;');
+      }
+
+      // ── Delete session ────────────────────────────────────────
+      $('btn-delete-session').addEventListener('click', async () => {
+        if (!_activeId) return;
+        if (!confirm('Delete session ' + shortId(_activeId) + '? This cannot be undone.')) return;
+        try {
+          const r = await fetch('/api/admin/sessions/' + encodeURIComponent(_activeId),
+            { method: 'DELETE', headers: { Authorization: authHeader() } });
+          if (!r.ok) throw new Error('HTTP ' + r.status);
+          showToast('Session deleted.', 'success');
+          _allSessions = _allSessions.filter(s => s.session_id !== _activeId);
+          _activeId = null;
+          $('chat-view').style.display = 'none';
+          $('placeholder').style.display = 'flex';
+          renderSidebar(_allSessions);
+          updateStats(_allSessions);
+        } catch (e) { showToast('Delete failed: ' + e.message, 'error') }
+      });
+
+      // ── Exports ───────────────────────────────────────────────
+      async function downloadExport(url, filename) {
+        try {
+          const r = await fetch(url, { headers: { Authorization: authHeader() } });
+          if (!r.ok) throw new Error('Export failed');
+          const blob = await r.blob();
+          const link = document.createElement('a');
+          link.href = window.URL.createObjectURL(blob);
+          link.download = filename;
+          link.click();
+          showToast('Export successful', 'success');
+        } catch (e) {
+          showToast('Export failed: ' + e.message, 'error');
+        }
+      }
+
+      $('btn-export-all-excel').addEventListener('click', () => {
+        downloadExport('/api/admin/export/all?format=excel', 'all_chats_export.xlsx');
+      });
+
+      $('btn-export-all-json').addEventListener('click', () => {
+        downloadExport('/api/admin/export/all?format=json', 'all_chats_export.json');
+      });
+
+      $('btn-export-session-excel').addEventListener('click', () => {
+        if (!_activeId) return;
+        downloadExport(`/api/admin/export/session/${encodeURIComponent(_activeId)}?format=excel`, `session_${_activeId}.xlsx`);
+      });
+
+      $('btn-export-session-json').addEventListener('click', () => {
+        if (!_activeId) return;
+        downloadExport(`/api/admin/export/session/${encodeURIComponent(_activeId)}?format=json`, `session_${_activeId}.json`);
+      });
+
+    })();
+  </script>
+</body>
+
+</html>

backup_2026-05-04/app/api/schemas.py

@@ -0,0 +1,27 @@
+from typing import List, Dict, Any
+
+from pydantic import BaseModel, Field
+
+
+class ChatRequest(BaseModel):
+    message: str = Field(..., min_length=1)
+    history: List[Dict[str, str]] = Field(default_factory=list)
+    session_id: str | None = Field(default=None, description="Unique session identifier for chat persistence")
+
+
+class ChatResponse(BaseModel):
+    reply: str
+    retrieved_chunks: List[Dict[str, Any]] = Field(default_factory=list)
+
+
+class HealthResponse(BaseModel):
+    status: str
+    docs_loaded: bool
+    index_ready: bool
+    chunk_count: int
+    index_path: str
+
+
+class SessionUpdateNameRequest(BaseModel):
+    session_id: str
+    user_name: str

backup_2026-05-04/app/core/config.py

@@ -0,0 +1,51 @@
+from functools import lru_cache
+from pathlib import Path
+from pydantic import Field, model_validator
+from pydantic_settings import BaseSettings, SettingsConfigDict
+
+
+class Settings(BaseSettings):
+    model_config = SettingsConfigDict(env_file=".env", env_file_encoding="utf-8")
+
+    app_name: str = "Fast RAG Chatbot"
+    llm_provider: str = Field(default="groq", alias="LLM_PROVIDER")
+    groq_api_key: str = Field(default="", alias="GROQ_API_KEY")
+    groq_model: str = Field(default="qwen/qwen3-32b", alias="GROQ_MODEL")
+    groq_rewrite_model: str = Field(default="llama-3.1-8b-instant", alias="GROQ_REWRITE_MODEL")
+    hf_api_key: str = Field(default="", alias="HF_API_KEY")
+    hf_model: str = Field(default="meta-llama/Llama-3.1-8B-Instruct", alias="HF_MODEL")
+    embedding_model: str = Field(default="BAAI/bge-small-en-v1.5", alias="EMBEDDING_MODEL")
+    reranker_model: str = Field(default="BAAI/bge-reranker-base", alias="RERANKER_MODEL")
+    docs_dir: Path = Field(default=Path("docs"), alias="DOCS_DIR")
+    @model_validator(mode='after')
+    def set_persistent_paths(self) -> 'Settings':
+        # If we are on Hugging Face (detected by /data volume), 
+        # force use of /data for persistence regardless of other settings.
+        if Path("/data").exists():
+            self.index_dir = Path("/data/index")
+            self.sessions_dir = Path("/data/sessions")
+        return self
+
+    index_dir: Path = Field(default=Path("data/index"), alias="INDEX_DIR")
+    sessions_dir: Path = Field(default=Path("data/sessions"), alias="SESSIONS_DIR")
+    chunk_size_tokens: int = 350  # Reduced for TPM safety
+    chunk_overlap_tokens: int = 80
+    top_k: int = Field(default=20, alias="TOP_K")  
+    max_context_chunks: int = 10  # Increased to 10 to ensure all list items (like leaves) are captured
+    request_timeout_s: float = 20.0
+    cors_allow_origins: str = Field(default="*", alias="CORS_ALLOW_ORIGINS")
+    api_key: str = Field(default="", alias="API_KEY")
+    rate_limit_requests: int = Field(default=60, alias="RATE_LIMIT_REQUESTS")
+    rate_limit_window_seconds: int = Field(default=60, alias="RATE_LIMIT_WINDOW_SECONDS")
+
+    # SMTP Settings for OTP
+    smtp_server: str = Field(default="smtp.gmail.com", alias="SMTP_SERVER")
+    smtp_port: int = Field(default=465, alias="SMTP_PORT")
+    smtp_user: str = Field(default="", alias="SMTP_USER")
+    smtp_pass: str = Field(default="", alias="SMTP_PASS")
+    admin_email: str = Field(default="randomjoedown@gmail.com", alias="ADMIN_EMAIL")
+
+
+@lru_cache
+def get_settings() -> Settings:
+    return Settings()

backup_2026-05-04/app/main.py

@@ -0,0 +1,196 @@
+import logging
+
+from fastapi import FastAPI, HTTPException, Header, Request
+from fastapi.responses import RedirectResponse
+from fastapi.middleware.cors import CORSMiddleware
+from fastapi.staticfiles import StaticFiles
+import os
+
+from app.api.schemas import ChatRequest, ChatResponse, HealthResponse, SessionUpdateNameRequest
+from app.core.config import get_settings
+from app.services.embeddings import EmbeddingService
+from app.services.llm import LLMService
+from app.services.rag_pipeline import RAGPipeline
+from app.services.rate_limiter import InMemoryRateLimiter
+from app.services.vector_store import FaissVectorStore
+from app.services.reranker import RerankerService
+from app.ui_gradio import demo
+from app.admin.router import admin_router
+from app.services import session_store as _ss
+import asyncio
+import gradio as gr
+
+logging.basicConfig(level=logging.INFO, format="%(asctime)s %(levelname)s %(name)s - %(message)s")
+logger = logging.getLogger(__name__)
+
+settings = get_settings()
+embedding_service = EmbeddingService(settings.embedding_model)
+vector_store = FaissVectorStore(
+    embedding_service=embedding_service,
+    docs_dir=settings.docs_dir,
+    index_dir=settings.index_dir,
+    chunk_size_tokens=settings.chunk_size_tokens,
+    chunk_overlap_tokens=settings.chunk_overlap_tokens,
+)
+llm_service = LLMService(
+    provider=settings.llm_provider,
+    groq_api_key=settings.groq_api_key,
+    groq_model=settings.groq_model,
+    groq_rewrite_model=settings.groq_rewrite_model,
+    hf_api_key=settings.hf_api_key,
+    hf_model=settings.hf_model,
+    timeout_s=settings.request_timeout_s,
+)
+reranker_service = RerankerService(settings.reranker_model)
+pipeline = RAGPipeline(
+    vector_store=vector_store, 
+    llm_service=llm_service, 
+    reranker=reranker_service,
+    top_k=settings.top_k,
+    max_context_chunks=settings.max_context_chunks
+)
+
+# ── FastAPI App ───────────────────────────────────────────────────────────────
+fastapi_app = FastAPI(title=settings.app_name)
+
+allow_origins = [o.strip() for o in settings.cors_allow_origins.split(",") if o.strip()]
+fastapi_app.add_middleware(
+    CORSMiddleware,
+    allow_origins=["*"], # Explicitly allow all for testing
+    allow_credentials=True,
+    allow_methods=["*"],
+    allow_headers=["*"],
+)
+
+rate_limiter = InMemoryRateLimiter(settings.rate_limit_requests, settings.rate_limit_window_seconds)
+
+# ── Admin Panel (mounted on FastAPI before Gradio wrapping) ───────────────────
+fastapi_app.include_router(admin_router)
+
+# ── Static Files ──────────────────────────────────────────────────────────────
+static_dir = os.path.join(os.path.dirname(os.path.dirname(__file__)), "static")
+if os.path.exists(static_dir):
+    fastapi_app.mount("/static", StaticFiles(directory=static_dir), name="static")
+
+@fastapi_app.get("/widget", include_in_schema=False)
+async def get_widget():
+    """Serves the chat widget HTML with explicit CORS headers."""
+    from fastapi.responses import FileResponse
+    path = os.path.join(static_dir, "addon.html")
+    if not os.path.exists(path):
+        raise HTTPException(status_code=404, detail="Widget not found")
+    return FileResponse(
+        path, 
+        headers={
+            "Access-Control-Allow-Origin": "*",
+            "Cache-Control": "no-cache, no-store, must-revalidate"
+        }
+    )
+
+
+@fastapi_app.on_event("startup")
+def startup_event() -> None:
+    logger.info("─── RAG SERVICE STARTUP ───")
+    logger.info("Index Directory: %s", settings.index_dir)
+    logger.info("Sessions Directory: %s", settings.sessions_dir)
+    
+    # Verify persistence mount
+    if str(settings.index_dir).startswith("/data"):
+        if os.path.exists("/data"):
+            logger.info("✅ Persistent storage /data detected and in use.")
+        else:
+            logger.warning("⚠️ /data requested but NOT found on filesystem!")
+    else:
+        logger.warning("⚠️ Using ephemeral storage (data will be lost on rebuild).")
+
+    logger.info("Loading/building FAISS index...")
+    vector_store.build_or_load()
+    logger.info("RAG service started with %s chunks", len(vector_store.metadata))
+
+
+@fastapi_app.get("/", include_in_schema=False)
+async def root():
+    """Prevent direct browser access to the root URL."""
+    raise HTTPException(
+        status_code=403, 
+        detail="Direct access to this resource is restricted. Please use the authorized interface."
+    )
+
+
+@fastapi_app.get("/health", response_model=HealthResponse)
+def health() -> HealthResponse:
+    h = vector_store.health()
+    return HealthResponse(status="ok", **h)
+
+
+@fastapi_app.post("/api/chat", response_model=ChatResponse)
+async def chat(
+    payload: ChatRequest,
+    request: Request,
+    x_api_key: str | None = Header(default=None),
+) -> ChatResponse:
+    if not payload.message.strip():
+        raise HTTPException(status_code=400, detail="message must not be empty")
+    if settings.api_key and x_api_key != settings.api_key:
+        raise HTTPException(status_code=401, detail="unauthorized")
+
+    client_ip = request.client.host if request.client else "unknown"
+    if not rate_limiter.allow(client_ip):
+        raise HTTPException(status_code=429, detail="rate limit exceeded")
+
+    logger.info("Incoming chat request: msg='%s', sid='%s'", payload.message[:30], payload.session_id)
+
+    # Fetch user_name if available for personalization
+    user_name = None
+    if payload.session_id:
+        sess_data = await _ss.get_session(payload.session_id)
+        user_name = sess_data.get("user_name")
+
+    try:
+        result = await pipeline.chat(payload.message, payload.history, user_name=user_name)
+        
+        # ── Fire-and-forget: persist to session store in background ──
+        if payload.session_id:
+            asyncio.create_task(_ss.save_message(payload.session_id, payload.message, result["reply"]))
+            
+        return ChatResponse(**result)
+    except Exception as e:
+        import httpx
+        import traceback
+        logger.error(f"Error in chat endpoint: {str(e)}\n{traceback.format_exc()}")
+        
+        error_msg = "⚠️ Oops! Something went wrong."
+        if isinstance(e, httpx.HTTPStatusError):
+            if e.response.status_code == 429:
+                error_msg = "⚠️ Rate limit reached. Please slow down a bit!"
+            else:
+                error_msg = "⚠️ I encountered an error. Please try again in a few seconds."
+                
+        return ChatResponse(reply=error_msg, retrieved_chunks=[])
+
+
+@fastapi_app.post("/api/session/update-name")
+async def update_session_user_name(payload: SessionUpdateNameRequest):
+    """Updates the user name and renames the session file to match the name."""
+    new_id = await _ss.rename_session(payload.session_id, payload.user_name)
+    return {"status": "ok", "new_session_id": new_id}
+
+
+@fastapi_app.get("/api/session/history/{session_id}")
+async def get_session_history(session_id: str):
+    """Returns the chat history for a session formatted for the frontend."""
+    data = await _ss.get_session(session_id)
+    if not data:
+        return {"history": []}
+    
+    history = []
+    for msg in data.get("messages", []):
+        history.append({"role": "user", "content": msg["question"]})
+        history.append({"role": "assistant", "content": msg["answer"]})
+    return {"history": history, "user_name": data.get("user_name", "")}
+
+
+# ── Mount Gradio at /ui — MUST be last, wraps the FastAPI app ─────────────────
+# All FastAPI routes (including /admin) are already registered above and are
+# preserved inside the Gradio-wrapped Starlette app.
+app = gr.mount_gradio_app(fastapi_app, demo, path="/ui")

backup_2026-05-04/app/services/chunker.py

@@ -0,0 +1,39 @@
+from typing import List, Dict
+
+
+def _tokenize(text: str) -> List[str]:
+    return text.split()
+
+
+def chunk_documents(
+    documents: List[Dict[str, str]],
+    chunk_size_tokens: int = 420,
+    chunk_overlap_tokens: int = 80,
+) -> List[Dict[str, str]]:
+    chunks: List[Dict[str, str]] = []
+    step = max(1, chunk_size_tokens - chunk_overlap_tokens)
+
+    for doc in documents:
+        tokens = _tokenize(doc["text"])
+        if not tokens:
+            continue
+
+        i = 0
+        chunk_id = 0
+        while i < len(tokens):
+            window = tokens[i : i + chunk_size_tokens]
+            if not window:
+                break
+
+            chunk_text = " ".join(window)
+            chunks.append(
+                {
+                    "id": f"{doc['source']}::chunk_{chunk_id}",
+                    "source": doc["source"],
+                    "text": chunk_text,
+                }
+            )
+            chunk_id += 1
+            i += step
+
+    return chunks

backup_2026-05-04/app/services/document_loader.py

@@ -0,0 +1,37 @@
+from pathlib import Path
+from typing import List
+
+from pypdf import PdfReader
+
+
+def _clean_text(text: str) -> str:
+    lines = [line.strip() for line in text.splitlines() if line.strip()]
+    merged = " ".join(lines)
+    return " ".join(merged.split())
+
+
+def load_documents(docs_dir: Path) -> List[dict]:
+    docs: List[dict] = []
+    if not docs_dir.exists():
+        return docs
+
+    for file_path in sorted(docs_dir.rglob("*")):
+        if not file_path.is_file():
+            continue
+
+        suffix = file_path.suffix.lower()
+        if suffix == ".txt":
+            raw = file_path.read_text(encoding="utf-8", errors="ignore")
+            cleaned = _clean_text(raw)
+            if cleaned:
+                docs.append({"source": str(file_path), "text": cleaned})
+        elif suffix == ".pdf":
+            reader = PdfReader(str(file_path))
+            pages = []
+            for page in reader.pages:
+                pages.append(page.extract_text() or "")
+            cleaned = _clean_text("\n".join(pages))
+            if cleaned:
+                docs.append({"source": str(file_path), "text": cleaned})
+
+    return docs

backup_2026-05-04/app/services/embeddings.py

@@ -0,0 +1,34 @@
+from typing import List
+from functools import lru_cache
+
+import numpy as np
+from sentence_transformers import SentenceTransformer
+
+
+class EmbeddingService:
+    def __init__(self, model_name: str) -> None:
+        self.model = SentenceTransformer(model_name)
+
+    def encode(self, texts: List[str]) -> np.ndarray:
+        vectors = self.model.encode(
+            texts,
+            normalize_embeddings=True,
+            show_progress_bar=False,
+            convert_to_numpy=True,
+        )
+        return np.asarray(vectors, dtype=np.float32)
+
+    @lru_cache(maxsize=2048)
+    def encode_query_cached(self, text: str) -> bytes:
+        vec = self.model.encode(
+            [text],
+            normalize_embeddings=True,
+            show_progress_bar=False,
+            convert_to_numpy=True,
+        )
+        arr = np.asarray(vec, dtype=np.float32)
+        return arr.tobytes()
+
+    def encode_query(self, text: str) -> np.ndarray:
+        buf = self.encode_query_cached(text)
+        return np.frombuffer(buf, dtype=np.float32).reshape(1, -1)

backup_2026-05-04/app/services/llm.py

@@ -0,0 +1,264 @@
+from typing import List, Dict
+import httpx
+import re
+
+# ═══════════════════════════════════════════════════════════════════════
+# MASTER SYSTEM PROMPT — Martechsol HR Assistant
+# Intelligence: Understand Intent → Retrieve Facts → Respond Precisely
+# ═══════════════════════════════════════════════════════════════════════
+SYSTEM_PROMPT = """You are the Martechsol HR Assistant — intelligent, precise, and formal.
+
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+STEP 1 — UNDERSTAND THE INTENT
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+Read the question carefully. Identify the SINGLE core topic being asked. Apply intelligent defaults:
+• "timing" / "timings" (no context) → office working hours ONLY — not payment or any other timing
+• "leaves" / "leave" (no context) → leave names + day counts ONLY — NOT leave policies or eligibility
+• "paid leaves" / "all leaves" → enumerate EVERY leave type with its name and count
+• "salary" / "pay" (no context) → salary structure or amount — NOT payment date unless explicitly asked
+• "benefits" / "perks" / "allowances" → list EVERY benefit with its name and value
+• "terminate" / "termination" → resignation/termination procedure — NOT general policies
+If a question has an obvious workplace context, always default to the most common interpretation.
+
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+STEP 2 — STRICT SCOPE DISCIPLINE
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+Answer ONLY what was asked. NEVER expand into:
+• Policies, approval processes, eligibility rules, or consequences — unless user asks for policy/process
+• Related topics the user did not mention
+• Broad overviews when a specific fact was requested
+• Context that wasn't in the question
+
+Scope examples:
+  "How many sick leaves?" → ONE number. Not the sick leave policy.
+  "What are office timings?" → ONE sentence with time range. Not break times or exceptions.
+  "What are paid leaves?" → Complete list of all paid leave types + counts. Not rules for taking them.
+  "Tell me about maternity leave" → Count + brief key fact. Not full policies unless asked.
+
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+STEP 3 — CHOOSE THE RIGHT FORMAT
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+
+FORMAT A — SINGLE FACT (default for most questions)
+  When: One direct answer needed (timings, a specific leave count, a single number/date)
+  Rule: ONE complete sentence. Maximum 25–30 words. Never cut mid-sentence.
+  Example: Office hours are <b>9:00 AM to 6:00 PM</b>, Monday to Saturday.
+
+FORMAT B — EXHAUSTIVE LIST
+  When: User asks for ALL items in a category ("all leaves", "all benefits", "list all X", "paid leaves")
+  Rule:
+    • Include EVERY single item found — omitting even one is FORBIDDEN
+    • One item per line: <b>Item Name:</b> value<br>
+    • No intro sentence, no closing sentence, no extra commentary
+    • Continue until ALL items are listed
+  Example:
+    <b>Casual Leave:</b> 10 days<br>
+    <b>Sick Leave:</b> 10 days<br>
+    <b>Annual Leave:</b> 14 days<br>
+    <b>Maternity Leave:</b> 90 days<br>
+    <b>Paternity Leave:</b> 3 days<br>
+    <b>Hajj Leave:</b> 30 days<br>
+    ...(list every item — do NOT stop early)
+
+FORMAT C — BRIEF EXPLANATION
+  When: User asks HOW something works, or asks for a process/procedure
+  Rule: Maximum 3 bullet points. Each bullet = one complete, factual sentence. No filler words.
+
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+STRICT QUALITY RULES
+━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
+✓ ZERO hallucination — every fact must exist in Expert Data only. No guessing.
+✓ If not in Expert Data → reply exactly: "I don't have that information."
+✓ Never cut a sentence mid-way — always complete every sentence fully
+✓ NEVER mention: "document", "handbook", "manual", "policy file", or any source reference
+✓ Use <b>bold</b> for names, numbers, dates, leave types, and all key terms
+✓ Use <br> between list items for clean vertical spacing
+✓ Tone: formal, warm, and professional — never robotic, never chatty
+✓ Do NOT add greetings, closings, or "Is there anything else?" type phrases"""
+
+
+def _build_context(chunks: List[Dict[str, str]], max_words: int = 1500) -> str:
+    """Combines retrieved chunks into a clean context string, capped at max_words.
+    Prevents TPM spikes when chunks are unexpectedly large."""
+    if not chunks:
+        return ""
+    parts = []
+    total_words = 0
+    for c in chunks:
+        text = c['text']
+        word_count = len(text.split())
+        if total_words + word_count > max_words:
+            # Add a trimmed version of this chunk if possible
+            remaining = max_words - total_words
+            if remaining > 30:  # Only worth adding if meaningful content remains
+                trimmed_words = text.split()[:remaining]
+                parts.append(" ".join(trimmed_words))
+            break
+        parts.append(text)
+        total_words += word_count
+    return "\n\n".join(parts)
+
+
+class LLMService:
+    def __init__(
+        self,
+        provider: str,
+        groq_api_key: str,
+        groq_model: str,
+        groq_rewrite_model: str,
+        hf_api_key: str,
+        hf_model: str,
+        timeout_s: float = 20.0,
+    ) -> None:
+        self.provider = provider.lower().strip()
+        self.groq_api_key = groq_api_key
+        self.groq_model = groq_model
+        self.groq_rewrite_model = groq_rewrite_model
+        self.hf_api_key = hf_api_key
+        self.hf_model = hf_model
+        self.timeout_s = timeout_s
+
+    async def generate_multi_queries(self, query: str, history: List[Dict[str, str]]) -> List[str]:
+        """Generates multiple search queries to capture broader context from the document."""
+        prompt = f"""You are an intelligent HR search optimizer. A user asked: "{query}"
+
+STEP 1 — UNDERSTAND THE INTENT:
+What is the user ACTUALLY asking about? Apply workplace common sense:
+- "timing" / "timings" (no qualifier) = office working hours, workday schedule
+- "leaves" / "paid leaves" / "all leaves" = all leave types available to employees
+- "salary" / "pay" = salary structure or amount
+- "benefits" / "allowances" = employee benefits and perks
+- "terminate" / "resign" = termination or resignation process
+
+STEP 2 — GENERATE 3 TARGETED SEARCH QUERIES:
+Write 3 diverse search queries to retrieve ALL relevant information from an employee handbook.
+For the identified intent, cover synonyms, related terms, and sub-categories:
+- For office timings → search: working hours, office schedule, workday timing, shift hours
+- For leaves → Query 1 MUST be a keyword dump: "casual leave sick leave annual leave maternity paternity hajj bereavement study unauthorized"
+- For salary → cover: salary structure, payroll, compensation, increments, deductions
+- For benefits → cover: allowances, perks, medical, bonuses, reimbursements
+
+Output ONLY 3 queries, one per line. No numbers, no bullets, no explanations.
+
+Queries:"""
+
+        try:
+            resp = await self._call_groq(
+                prompt, [],
+                "You output only search queries, one per line. No explanations, no numbering.",
+                model_override=self.groq_rewrite_model
+            )
+            queries = [
+                q.strip().lstrip('0123456789.-) ').strip()
+                for q in resp.split("\n")
+                if q.strip() and len(q.strip()) > 3
+            ]
+            # Always include original query
+            if query not in queries:
+                queries.append(query)
+            return queries[:4]
+        except Exception:
+            return [query]
+
+    async def answer(
+        self,
+        question: str,
+        chunks: List[Dict[str, str]],
+        history: List[Dict[str, str]],
+        user_name: str = None
+    ) -> str:
+        # Keep only last 4 messages (2 turns) for TPM safety
+        pruned_history = history[-4:]
+        context = _build_context(chunks)
+
+        # Build system message
+        system_msg = SYSTEM_PROMPT
+        if user_name and user_name not in ("default name", "", None):
+            system_msg += f"\n\nYou are speaking with {user_name}."
+
+        # Build user prompt — clean and direct
+        if not context:
+            user_prompt = question
+        else:
+            user_prompt = f"Expert Data:\n{context}\n\nQuestion: {question}"
+
+        return await self._call_groq(user_prompt, pruned_history, system_msg)
+
+    async def _call_groq(
+        self,
+        user_prompt: str,
+        history: List[Dict[str, str]],
+        system_msg: str,
+        model_override: str = None
+    ) -> str:
+        if not self.groq_api_key:
+            return "Expert access required."
+
+        url = "https://api.groq.com/openai/v1/chat/completions"
+        headers = {
+            "Authorization": f"Bearer {self.groq_api_key}",
+            "Content-Type": "application/json"
+        }
+
+        messages = [{"role": "system", "content": system_msg}]
+        for msg in history:
+            messages.append({"role": msg["role"], "content": msg["content"]})
+        messages.append({"role": "user", "content": user_prompt})
+
+        target_model = model_override or self.groq_model
+
+        # Qwen3 and DeepSeek-R1 are thinking models
+        is_thinking_model = any(k in target_model.lower() for k in ["deepseek", "qwen3", "qwen/qwen3"])
+        temp = 0.6 if is_thinking_model else 0.0
+
+        # For Qwen3: suppress thinking mode on answer calls to reduce latency & TPM usage.
+        # /no_think is Qwen3's built-in signal to skip chain-of-thought reasoning.
+        # We ONLY suppress for the main answer model, not the rewrite model.
+        if is_thinking_model and model_override is None:
+            messages[-1]["content"] = "/no_think\n\n" + messages[-1]["content"]
+
+        payload = {
+            "model": target_model,
+            "temperature": temp,
+            "max_tokens": 512,  # Enough for complete listings with HTML, well within TPM limits
+            "messages": messages,
+        }
+
+        async with httpx.AsyncClient(timeout=self.timeout_s) as client:
+            resp = await client.post(url, headers=headers, json=payload)
+            if resp.status_code >= 400:
+                import logging
+                logging.getLogger(__name__).error(
+                    f"Groq API Error {resp.status_code}: {resp.text}"
+                )
+            resp.raise_for_status()
+            data = resp.json()
+            content = data["choices"][0]["message"]["content"].strip()
+
+            # ── Post-Processing: Strip all internal reasoning artifacts ──
+
+            # 1. Strip <think>...</think> blocks (Qwen3, DeepSeek-R1)
+            content = re.sub(r'<think>.*?</think>', '', content, flags=re.DOTALL).strip()
+
+            # 2. Strip leading conversational filler (single line only, not entire content)
+            content = re.sub(
+                r'^(Okay[,.]?\s*|Alright[,.]?\s*|Sure[,.]?\s*|Let\'s see[,.]?\s*|'
+                r'Based on (?:the )?(?:provided |available )?(?:data|information|context)[,.]?\s*|'
+                r'According to (?:the )?(?:provided |available )?(?:data|information)[,.]?\s*)',
+                '', content, flags=re.IGNORECASE
+            ).strip()
+
+            # 3. Remove lines that are pure internal self-talk (only if they appear alone at start)
+            lines = content.split('\n')
+            filtered = []
+            for i, line in enumerate(lines):
+                is_self_talk = bool(re.match(
+                    r'^\s*(I need to|I will|I should|I\'m going to|Let me|Now I|First,? I|'
+                    r'I\'ll|The user is asking|The question is about)',
+                    line, re.IGNORECASE
+                ))
+                if not is_self_talk:
+                    filtered.append(line)
+            content = '\n'.join(filtered).strip()
+
+            return content

backup_2026-05-04/app/services/rag_pipeline.py

@@ -0,0 +1,98 @@
+import logging
+from typing import Dict, List
+
+from app.services.llm import LLMService
+from app.services.vector_store import FaissVectorStore
+from app.services.reranker import RerankerService
+
+logger = logging.getLogger(__name__)
+
+# RRF scores are small (e.g. 0.016–0.033), so threshold must be very low
+RELEVANCE_THRESHOLD = 0.01
+# Cross-encoder logit > 0 means > 50% relevance probability
+RERANK_THRESHOLD = 0.0
+# If ALL chunks fail rerank threshold, fall back to this many top chunks
+RERANK_FALLBACK_N = 2
+
+
+class RAGPipeline:
+    def __init__(
+        self,
+        vector_store: FaissVectorStore,
+        llm_service: LLMService,
+        reranker: RerankerService,
+        top_k: int,
+        max_context_chunks: int
+    ) -> None:
+        self.vector_store = vector_store
+        self.llm_service = llm_service
+        self.reranker = reranker
+        self.top_k = top_k
+        self.max_context_chunks = max_context_chunks
+
+    async def chat(self, message: str, history: List[Dict[str, str]], user_name: str = None) -> Dict[str, object]:
+        # ── Step 1: Generate multiple search queries for broad coverage ──
+        queries = await self.llm_service.generate_multi_queries(message, history)
+        logger.info("Generated %d queries for: '%s' → %s", len(queries), message[:40], queries)
+
+        # ── Step 2: Collect unique chunks across all queries ──
+        seen_ids = set()
+        all_retrieved = []
+
+        for q in queries:
+            query_chunks = self.vector_store.search(q, top_k=self.top_k)
+            for chunk in query_chunks:
+                if chunk["id"] not in seen_ids:
+                    all_retrieved.append(chunk)
+                    seen_ids.add(chunk["id"])
+
+        # ── Step 3: Initial relevance filter ──
+        initial_chunks = [c for c in all_retrieved if c["score"] >= RELEVANCE_THRESHOLD]
+
+        if not initial_chunks:
+            logger.info("No relevant chunks found for: '%s' — returning no-info response", message)
+            # Pass empty chunks; LLM is instructed to say "I don't have that information"
+            reply = await self.llm_service.answer(
+                question=message,
+                chunks=[],
+                history=history,
+                user_name=user_name
+            )
+            return {"reply": reply, "retrieved_chunks": []}
+
+        # ── Step 4: Deep reranking via Cross-Encoder ──
+        # Enrihc the reranker query with the LLM's expanded search terms
+        rerank_query = message
+        if len(queries) > 0 and queries[0] != message:
+            rerank_query = f"{message} {queries[0]}"
+            
+        reranked_chunks = self.reranker.rerank(rerank_query, initial_chunks, top_n=self.max_context_chunks)
+
+        # Filter by rerank score threshold
+        final_chunks = [c for c in reranked_chunks if c.get("rerank_score", 0) > RERANK_THRESHOLD]
+
+        # ── Smart Fallback: if ALL chunks fail the threshold, use the top N anyway ──
+        # This prevents the bot from saying "I don't have info" when content WAS retrieved
+        # but the cross-encoder wasn't confident enough (e.g. paraphrased queries)
+        if not final_chunks and reranked_chunks:
+            final_chunks = reranked_chunks[:RERANK_FALLBACK_N]
+            logger.info(
+                "Rerank fallback activated — all chunks below threshold (best score=%.3f), using top %d",
+                reranked_chunks[0].get("rerank_score", 0),
+                len(final_chunks)
+            )
+
+        logger.info(
+            "Pipeline: retrieved=%d → relevance_filtered=%d → reranked=%d → final=%d (best_score=%.3f)",
+            len(all_retrieved), len(initial_chunks), len(reranked_chunks), len(final_chunks),
+            reranked_chunks[0].get("rerank_score", 0) if reranked_chunks else 0.0
+        )
+
+        # ── Step 5: Generate answer with top-ranked context ──
+        reply = await self.llm_service.answer(
+            question=message,
+            chunks=final_chunks,
+            history=history,
+            user_name=user_name
+        )
+        return {"reply": reply, "retrieved_chunks": final_chunks}

backup_2026-05-04/app/services/rate_limiter.py

@@ -0,0 +1,24 @@
+import time
+from collections import defaultdict, deque
+from typing import Deque, Dict
+
+
+class InMemoryRateLimiter:
+    def __init__(self, max_requests: int, window_seconds: int) -> None:
+        self.max_requests = max_requests
+        self.window_seconds = window_seconds
+        self._hits: Dict[str, Deque[float]] = defaultdict(deque)
+
+    def allow(self, key: str) -> bool:
+        now = time.time()
+        window_start = now - self.window_seconds
+        q = self._hits[key]
+
+        while q and q[0] < window_start:
+            q.popleft()
+
+        if len(q) >= self.max_requests:
+            return False
+
+        q.append(now)
+        return True

backup_2026-05-04/app/services/reranker.py

@@ -0,0 +1,26 @@
+from typing import List, Dict
+import numpy as np
+from sentence_transformers import CrossEncoder
+
+class RerankerService:
+    def __init__(self, model_name: str) -> None:
+        self.model = CrossEncoder(model_name)
+
+    def rerank(self, query: str, chunks: List[Dict[str, str]], top_n: int = 4) -> List[Dict[str, str]]:
+        if not chunks:
+            return []
+        
+        # Prepare pairs for cross-encoder
+        pairs = [[query, chunk["text"]] for chunk in chunks]
+        
+        # Get scores
+        scores = self.model.predict(pairs)
+        
+        # Add scores to chunks and sort
+        for i, chunk in enumerate(chunks):
+            chunk["rerank_score"] = float(scores[i])
+            
+        # Sort by rerank_score descending
+        sorted_chunks = sorted(chunks, key=lambda x: x["rerank_score"], reverse=True)
+        
+        return sorted_chunks[:top_n]

backup_2026-05-04/app/services/session_store.py

@@ -0,0 +1,284 @@
+"""
+session_store.py
+────────────────
+Async, fire-and-forget JSON-based chat session storage.
+Each browser session gets its own JSON file in data/sessions/.
+
+Rules:
+  • NEVER raises exceptions that propagate upward — any failure is silently logged.
+  • ALL disk I/O is done with asyncio to avoid blocking the event loop.
+  • Thread-safe: uses an asyncio.Lock per session_id to avoid race conditions.
+"""
+
+import asyncio
+import json
+import logging
+import os
+from datetime import datetime, timezone
+from pathlib import Path
+from typing import Dict
+
+from app.core.config import get_settings
+logger = logging.getLogger(__name__)
+settings = get_settings()
+
+# ── Directory where session JSON files are stored ───────────────────────────
+def _get_sessions_dir() -> Path:
+    """Returns the current sessions directory from settings."""
+    return settings.sessions_dir
+
+
+# ── Per-session locks to prevent concurrent write corruption ─────────────────
+_session_locks: Dict[str, asyncio.Lock] = {}
+_locks_meta_lock = asyncio.Lock()  # protects the _session_locks dict itself
+
+
+def _get_session_path(session_id: str) -> Path:
+    """Returns the absolute path for a session's JSON file."""
+    return _get_sessions_dir() / f"{session_id}.json"
+
+
+def _now_iso() -> str:
+    """Returns the current UTC time as an ISO-8601 string."""
+    return datetime.now(timezone.utc).isoformat()
+
+
+async def _get_lock(session_id: str) -> asyncio.Lock:
+    """Gets or creates a per-session asyncio.Lock in a thread-safe manner."""
+    async with _locks_meta_lock:
+        if session_id not in _session_locks:
+            _session_locks[session_id] = asyncio.Lock()
+        return _session_locks[session_id]
+
+
+def _ensure_sessions_dir() -> None:
+    """Creates the sessions directory if it does not exist. Sync, called once."""
+    try:
+        _get_sessions_dir().mkdir(parents=True, exist_ok=True)
+    except OSError as exc:
+        logger.error("session_store: cannot create sessions dir: %s", exc)
+
+
+# Call once at import time so the directory is always ready.
+_ensure_sessions_dir()
+
+
+async def ensure_session(session_id: str) -> None:
+    """
+    Creates the session JSON file if it doesn't exist yet.
+    Safe to call on every page load — does nothing if file exists.
+    """
+    path = _get_session_path(session_id)
+    if path.exists():
+        return
+    lock = await _get_lock(session_id)
+    async with lock:
+        # Double-check after acquiring lock
+        if path.exists():
+            return
+        skeleton = {
+            "session_id": session_id,
+            "user_name": "default name",
+            "created_at": _now_iso(),
+            "last_active": _now_iso(),
+            "message_count": 0,
+            "messages": [],
+        }
+        try:
+            await asyncio.to_thread(_write_json, path, skeleton)
+            logger.info("session_store: created session %s", session_id)
+        except Exception as exc:
+            logger.error("session_store: failed to create session %s: %s", session_id, exc)
+
+
+async def save_message(session_id: str, question: str, answer: str) -> None:
+    """
+    Appends a Question+Answer pair with timestamps to the session's JSON file.
+    Fire-and-forget safe — caller should wrap in asyncio.create_task().
+    """
+    path = _get_session_path(session_id)
+    logger.info("session_store: save_message called for session_id=%s, path=%s", session_id, path)
+    lock = await _get_lock(session_id)
+    async with lock:
+        try:
+            # Load current data
+            if path.exists():
+                data = await asyncio.to_thread(_read_json, path)
+            else:
+                # Session file missing — recreate it gracefully
+                data = {
+                    "session_id": session_id,
+                    "user_name": "default name",
+                    "created_at": _now_iso(),
+                    "last_active": _now_iso(),
+                    "message_count": 0,
+                    "messages": [],
+                }
+
+            timestamp = _now_iso()
+            data["messages"].append({
+                "id": data["message_count"] + 1,
+                "timestamp": timestamp,
+                "question": question,
+                "answer": answer,
+            })
+            data["message_count"] += 1
+            data["last_active"] = timestamp
+
+            await asyncio.to_thread(_write_json, path, data)
+            logger.info("session_store: successfully saved message to %s", path)
+        except Exception as exc:
+            logger.error(
+                "session_store: failed to save message for session %s: %s",
+                session_id,
+                exc,
+            )
+
+
+async def get_all_sessions() -> list:
+    """
+    Returns a list of all session summaries (metadata only, no full messages).
+    Used by the Admin Panel sidebar.
+    """
+    try:
+        files = await asyncio.to_thread(_list_json_files)
+        sessions = []
+        for fpath in files:
+            try:
+                data = await asyncio.to_thread(_read_json, fpath)
+                sessions.append({
+                    "session_id": data.get("session_id", fpath.stem),
+                    "user_name": data.get("user_name", ""),
+                    "created_at": data.get("created_at", ""),
+                    "last_active": data.get("last_active", ""),
+                    "message_count": data.get("message_count", 0),
+                })
+            except Exception as exc:
+                logger.warning("session_store: could not read %s: %s", fpath, exc)
+        # Sort newest first
+        sessions.sort(key=lambda s: s.get("last_active", ""), reverse=True)
+        return sessions
+    except Exception as exc:
+        logger.error("session_store: get_all_sessions failed: %s", exc)
+        return []
+
+
+async def get_session(session_id: str) -> dict:
+    """
+    Returns the full session data (including all messages) for the Admin Panel.
+    Returns an empty dict if the session does not exist.
+    """
+    path = _get_session_path(session_id)
+    try:
+        if not path.exists():
+            return {}
+        return await asyncio.to_thread(_read_json, path)
+    except Exception as exc:
+        logger.error("session_store: get_session(%s) failed: %s", session_id, exc)
+        return {}
+
+
+async def delete_session(session_id: str) -> bool:
+    """
+    Deletes a session file. Returns True on success, False on failure.
+    Used by Admin Panel if needed in the future.
+    """
+    path = _get_session_path(session_id)
+    lock = await _get_lock(session_id)
+    async with lock:
+        try:
+            if path.exists():
+                await asyncio.to_thread(os.remove, path)
+            return True
+        except Exception as exc:
+            logger.error("session_store: delete_session(%s) failed: %s", session_id, exc)
+            return False
+
+
+async def update_session_name(session_id: str, user_name: str) -> None:
+    """Updates the user_name field in the session JSON file."""
+    path = _get_session_path(session_id)
+    lock = await _get_lock(session_id)
+    async with lock:
+        try:
+            if path.exists():
+                data = await asyncio.to_thread(_read_json, path)
+                data["user_name"] = user_name
+                await asyncio.to_thread(_write_json, path, data)
+                logger.info("session_store: updated name for session %s to %s", session_id, user_name)
+            else:
+                # If session doesn't exist yet, we can't update it, but we could create it?
+                # Usually ensure_session is called first.
+                logger.warning("session_store: attempt to update name for non-existent session %s", session_id)
+        except Exception as exc:
+            logger.error("session_store: failed to update name for session %s: %s", session_id, exc)
+
+
+async def rename_session(old_id: str, new_name: str) -> str:
+    """
+    Renames a session file from old_id to a name based on new_name.
+    Returns the new session_id used.
+    """
+    import re
+    # 1. Sanitize the name for use as a filename
+    clean_name = re.sub(r'[^\w\s-]', '', new_name).strip().replace(' ', '_')
+    if not clean_name:
+        clean_name = "User"
+    
+    new_id = clean_name
+    old_path = _get_session_path(old_id)
+    new_path = _get_session_path(new_id)
+
+    # Ensure uniqueness: if John_Doe exists, try John_Doe_1, etc.
+    counter = 1
+    while new_path.exists() and new_id != old_id:
+        new_id = f"{clean_name}_{counter}"
+        new_path = _get_session_path(new_id)
+        counter += 1
+
+    if new_id == old_id:
+        return old_id
+
+    # Lock both IDs to prevent race conditions during move
+    lock_old = await _get_lock(old_id)
+    lock_new = await _get_lock(new_id)
+    
+    async with lock_old:
+        async with lock_new:
+            try:
+                if old_path.exists():
+                    data = await asyncio.to_thread(_read_json, old_path)
+                    data["session_id"] = new_id
+                    data["user_name"] = new_name
+                    
+                    # Write to new path and delete old
+                    await asyncio.to_thread(_write_json, new_path, data)
+                    await asyncio.to_thread(os.remove, old_path)
+                    
+                    logger.info("session_store: renamed session %s -> %s", old_id, new_id)
+                    return new_id
+                else:
+                    logger.warning("session_store: cannot rename non-existent session %s", old_id)
+                    return old_id
+            except Exception as exc:
+                logger.error("session_store: failed to rename session %s: %s", old_id, exc)
+                return old_id
+
+
+# ── Sync helper functions (run via asyncio.to_thread) ────────────────────────
+
+def _write_json(path: Path, data: dict) -> None:
+    """Atomically writes JSON to a file using a temp file + rename pattern."""
+    tmp_path = path.with_suffix(".tmp")
+    with open(tmp_path, "w", encoding="utf-8") as f:
+        json.dump(data, f, ensure_ascii=False, indent=2)
+    os.replace(tmp_path, path)  # Atomic on POSIX, best-effort on Windows
+
+
+def _read_json(path: Path) -> dict:
+    with open(path, "r", encoding="utf-8") as f:
+        return json.load(f)
+
+
+def _list_json_files() -> list:
+    return list(_get_sessions_dir().glob("*.json"))

backup_2026-05-04/app/services/vector_store.py

@@ -0,0 +1,167 @@
+import hashlib
+import json
+from pathlib import Path
+from typing import Dict, List, Tuple
+
+import faiss
+import numpy as np
+import pickle
+from rank_bm25 import BM25Okapi
+
+from app.services.chunker import chunk_documents
+from app.services.document_loader import load_documents
+from app.services.embeddings import EmbeddingService
+
+
+class FaissVectorStore:
+    def __init__(
+        self,
+        embedding_service: EmbeddingService,
+        docs_dir: Path,
+        index_dir: Path,
+        chunk_size_tokens: int,
+        chunk_overlap_tokens: int,
+    ) -> None:
+        self.embedding_service = embedding_service
+        self.docs_dir = docs_dir
+        self.index_dir = index_dir
+        self.chunk_size_tokens = chunk_size_tokens
+        self.chunk_overlap_tokens = chunk_overlap_tokens
+
+        self.faiss_index_path = index_dir / "faiss.index"
+        self.bm25_index_path = index_dir / "bm25.pkl"
+        self.metadata_path = index_dir / "metadata.json"
+        self.state_path = index_dir / "state.json"
+
+        self.index = None
+        self.bm25 = None
+        self.metadata: List[Dict[str, str]] = []
+        self.docs_loaded = False
+        self.last_retrieved: List[Dict[str, str]] = []
+
+    def _compute_docs_fingerprint(self) -> str:
+        hasher = hashlib.sha256()
+        # Include chunk settings in fingerprint so changing them triggers re-index
+        hasher.update(str(self.chunk_size_tokens).encode("utf-8"))
+        hasher.update(str(self.chunk_overlap_tokens).encode("utf-8"))
+        
+        if not self.docs_dir.exists():
+            return "no_docs"
+        for path in sorted(self.docs_dir.rglob("*")):
+            if path.is_file() and path.suffix.lower() in {".txt", ".pdf"}:
+                stat = path.stat()
+                hasher.update(str(path).encode("utf-8"))
+                hasher.update(str(stat.st_mtime_ns).encode("utf-8"))
+                hasher.update(str(stat.st_size).encode("utf-8"))
+        return hasher.hexdigest()
+
+    def _can_use_cached_index(self, fingerprint: str) -> bool:
+        if not (self.faiss_index_path.exists() and self.metadata_path.exists() and self.state_path.exists()):
+            return False
+        try:
+            state = json.loads(self.state_path.read_text(encoding="utf-8"))
+            return state.get("docs_fingerprint") == fingerprint
+        except Exception:
+            return False
+
+    def build_or_load(self) -> None:
+        self.index_dir.mkdir(parents=True, exist_ok=True)
+        fingerprint = self._compute_docs_fingerprint()
+
+        if self._can_use_cached_index(fingerprint):
+            self.index = faiss.read_index(str(self.faiss_index_path))
+            with open(self.bm25_index_path, "rb") as f:
+                self.bm25 = pickle.load(f)
+            self.metadata = json.loads(self.metadata_path.read_text(encoding="utf-8"))
+            self.docs_loaded = len(self.metadata) > 0
+            return
+
+        docs = load_documents(self.docs_dir)
+        chunks = chunk_documents(docs, self.chunk_size_tokens, self.chunk_overlap_tokens)
+        if not chunks:
+            self.index = None
+            self.metadata = []
+            self.docs_loaded = False
+            return
+
+        vectors = self.embedding_service.encode([c["text"] for c in chunks])
+        dim = vectors.shape[1]
+        index = faiss.IndexFlatIP(dim)
+        index.add(vectors)
+
+        tokenized_corpus = [c["text"].lower().split() for c in chunks]
+        bm25 = BM25Okapi(tokenized_corpus)
+
+        self.index = index
+        self.bm25 = bm25
+        self.metadata = chunks
+        self.docs_loaded = True
+
+        faiss.write_index(index, str(self.faiss_index_path))
+        with open(self.bm25_index_path, "wb") as f:
+            pickle.dump(bm25, f)
+        self.metadata_path.write_text(json.dumps(chunks, ensure_ascii=False, indent=2), encoding="utf-8")
+        self.state_path.write_text(
+            json.dumps({"docs_fingerprint": fingerprint, "chunk_count": len(chunks)}, indent=2),
+            encoding="utf-8",
+        )
+
+    def search(self, query: str, top_k: int = 4) -> List[Dict[str, str]]:
+        if self.index is None or not self.metadata or self.bm25 is None:
+            self.last_retrieved = []
+            return []
+
+        # Vector Search (FAISS)
+        query_vec = self.embedding_service.encode_query(query)
+        faiss_scores, faiss_indices = self.index.search(np.asarray(query_vec, dtype=np.float32), top_k * 2)
+
+        # BM25 Search
+        tokenized_query = query.lower().split()
+        bm25_scores = self.bm25.get_scores(tokenized_query)
+        
+        # Get top indices for BM25
+        bm25_top_indices = np.argsort(bm25_scores)[::-1][:top_k * 2]
+
+        # Combine using Reciprocal Rank Fusion (RRF)
+        # RRF_score = 1 / (k + rank)
+        k = 60
+        rrf_scores = {}
+        
+        # Add FAISS ranks
+        for rank, idx in enumerate(faiss_indices[0]):
+            if idx < 0 or idx >= len(self.metadata):
+                continue
+            rrf_scores[idx] = rrf_scores.get(idx, 0.0) + (1.0 / (k + rank + 1))
+            
+        # Add BM25 ranks
+        for rank, idx in enumerate(bm25_top_indices):
+            if idx < 0 or idx >= len(self.metadata):
+                continue
+            rrf_scores[idx] = rrf_scores.get(idx, 0.0) + (1.0 / (k + rank + 1))
+
+        # Sort by combined RRF score
+        sorted_indices = sorted(rrf_scores.keys(), key=lambda x: rrf_scores[x], reverse=True)[:top_k]
+
+        results: List[Dict[str, str]] = []
+        for idx in sorted_indices:
+            chunk = self.metadata[idx]
+            # Fetch the original FAISS score for fallback relevance checking if needed, or just use RRF score
+            # Note: RRF scores are small (e.g. 0.03), so we must adjust the threshold in rag_pipeline
+            results.append(
+                {
+                    "id": chunk["id"],
+                    "source": chunk["source"],
+                    "text": chunk["text"],
+                    "score": float(rrf_scores[idx]), # RRF score
+                }
+            )
+        self.last_retrieved = results
+        return results
+
+    def health(self) -> Dict[str, object]:
+        return {
+            "docs_loaded": self.docs_loaded,
+            "index_ready": self.index is not None,
+            "chunk_count": len(self.metadata),
+            "index_path": str(self.faiss_index_path),
+        }

backup_2026-05-04/app/ui_gradio.py

@@ -0,0 +1,275 @@
+import asyncio
+import logging
+import os
+import random
+import string
+import traceback
+import uuid
+from typing import Dict, List, Tuple
+
+from app.services import session_store as _ss
+
+import gradio as gr
+import httpx
+
+from app.core.config import get_settings
+from app.services.embeddings import EmbeddingService
+from app.services.llm import LLMService
+from app.services.rag_pipeline import RAGPipeline
+from app.services.vector_store import FaissVectorStore
+from app.services.reranker import RerankerService
+
+logger = logging.getLogger(__name__)
+settings = get_settings()
+API_URL = os.getenv("RAG_API_URL", "").strip()
+
+# Initialize services
+embedding_service = EmbeddingService(settings.embedding_model)
+vector_store = FaissVectorStore(
+    embedding_service=embedding_service,
+    docs_dir=settings.docs_dir,
+    index_dir=settings.index_dir,
+    chunk_size_tokens=settings.chunk_size_tokens,
+    chunk_overlap_tokens=settings.chunk_overlap_tokens,
+)
+llm_service = LLMService(
+    provider=settings.llm_provider,
+    groq_api_key=settings.groq_api_key,
+    groq_model=settings.groq_model,
+    groq_rewrite_model=settings.groq_rewrite_model,
+    hf_api_key=settings.hf_api_key,
+    hf_model=settings.hf_model,
+    timeout_s=settings.request_timeout_s,
+)
+reranker_service = RerankerService(settings.reranker_model)
+pipeline = RAGPipeline(
+    vector_store=vector_store, 
+    llm_service=llm_service, 
+    reranker=reranker_service,
+    top_k=settings.top_k,
+    max_context_chunks=settings.max_context_chunks
+)
+
+# Ensure index is ready
+vector_store.build_or_load()
+
+
+# ── Keyboard layout for realistic typos ──────────────────────────────
+NEARBY_KEYS = {
+    'a': 'sqwz', 'b': 'vghn', 'c': 'xdfv', 'd': 'sfecx', 'e': 'wrsdf',
+    'f': 'dgrtcv', 'g': 'fhtybn', 'h': 'gjyunb', 'i': 'uojkl', 'j': 'hkunmi',
+    'k': 'jlomi', 'l': 'kop', 'm': 'njk', 'n': 'bhjm', 'o': 'ipkl',
+    'p': 'ol', 'q': 'wa', 'r': 'edft', 's': 'awedxz', 't': 'rfgy',
+    'u': 'yihj', 'v': 'cfgb', 'w': 'qase', 'x': 'zsdc', 'y': 'tghu',
+    'z': 'xas',
+}
+
+TYPO_CHANCE = 0.07  # 7% chance per word
+
+
+def _nearby_char(ch: str) -> str:
+    """Return a plausible neighbouring key for the given character."""
+    lower = ch.lower()
+    if lower in NEARBY_KEYS:
+        replacement = random.choice(NEARBY_KEYS[lower])
+        return replacement.upper() if ch.isupper() else replacement
+    return random.choice(string.ascii_lowercase)
+
+
+def _to_history(messages: List[Dict[str, str]]) -> list:
+    """Returns the history as a list of dicts (already in this format for Gradio 5)."""
+    return messages
+
+
+async def _chat_via_api(message: str, history: List[Dict[str, str]]) -> str:
+    payload = {"message": message, "history": history}
+    headers = {"Content-Type": "application/json"}
+    if settings.api_key:
+        headers["x-api-key"] = settings.api_key
+    
+    async with httpx.AsyncClient(timeout=30.0) as client:
+        resp = await client.post(API_URL, json=payload, headers=headers)
+        if resp.status_code == 429:
+            return "⚠️ I'm receiving too many requests right now. Please wait a moment before sending another message."
+        resp.raise_for_status()
+        return resp.json()["reply"]
+
+
+async def _get_reply(message: str, chat_history: List[Dict[str, str]]) -> str:
+    """Fetch the full reply from the LLM (API or direct pipeline)."""
+    if API_URL:
+        return await _chat_via_api(message, chat_history)
+    result = await pipeline.chat(message=message, history=chat_history)
+    return result["reply"]
+
+
+async def chat_fn(message: str, chat_history: List[Dict[str, str]], session_id: str = ""):
+    """Streaming generator: yields word-by-word with human-like timing & typos."""
+    if not message or not message.strip():
+        yield gr.update(interactive=True), chat_history
+        return
+
+    original_history = chat_history.copy()
+    chat_history = chat_history + [
+        {"role": "user", "content": message},
+        {"role": "assistant", "content": ""}
+    ]
+    yield gr.update(value="", interactive=False), chat_history
+
+    try:
+        reply = await _get_reply(message, original_history)
+    except httpx.HTTPStatusError as e:
+        logger.error(f"HTTP Error: {e.response.status_code} - {e.response.text}")
+        reply = "⚠️ Rate limit reached. Please slow down a bit!" if e.response.status_code == 429 \
+            else "⚠️ I encountered an error. Please try again in a few seconds."
+    except Exception as e:
+        logger.error(f"Unexpected error: {str(e)}\n{traceback.format_exc()}")
+        reply = f"⚠️ Oops! Something went wrong."
+
+    # ── Humanistic letter-by-letter typing — HTML-safe ────────────────────
+    displayed = ""       # what is shown in the chat bubble
+    buffer = ""          # invisible accumulator for mid-HTML-tag characters
+    in_tag = False       # True while we are inside a < … > sequence
+
+    for char in reply:
+        if char == '<':
+            in_tag = True
+            buffer += char
+            continue
+
+        if in_tag:
+            buffer += char
+            if char == '>':
+                # Tag is now complete — flush it to the display all at once
+                in_tag = False
+                displayed += buffer
+                buffer = ""
+                chat_history[-1] = {"role": "assistant", "content": displayed}
+                yield gr.update(value="", interactive=False), chat_history
+                # Small pause after a <br> to mimic line-break pacing
+                if displayed.endswith('<br>') or displayed.endswith('<br/>'):
+                    await asyncio.sleep(random.uniform(0.1, 0.2))
+            continue
+
+        # ── Normal character (not inside a tag) ───────────────────────────
+        # Decide typo chance only for plain alphabetic words
+        do_typo = (
+            char.isalpha()
+            and len(displayed) > 8           # skip the very beginning
+            and random.random() < TYPO_CHANCE
+        )
+
+        if do_typo:
+            wrong_char = _nearby_char(char)
+            displayed += wrong_char
+            chat_history[-1] = {"role": "assistant", "content": displayed}
+            yield gr.update(value="", interactive=False), chat_history
+            await asyncio.sleep(random.uniform(0.15, 0.3))
+
+            # Backspace the wrong character
+            displayed = displayed[:-1]
+            chat_history[-1] = {"role": "assistant", "content": displayed}
+            yield gr.update(value="", interactive=False), chat_history
+            await asyncio.sleep(random.uniform(0.1, 0.2))
+
+        # Type the correct character
+        displayed += char
+        chat_history[-1] = {"role": "assistant", "content": displayed}
+        yield gr.update(value="", interactive=False), chat_history
+
+        # Pacing: punctuation pauses, space micro-pause, normal char speed
+        if char in '.!?':
+            await asyncio.sleep(random.uniform(0.35, 0.7))
+        elif char in ',:;':
+            await asyncio.sleep(random.uniform(0.15, 0.3))
+        elif char == ' ':
+            await asyncio.sleep(random.uniform(0.06, 0.13))
+        else:
+            await asyncio.sleep(random.uniform(0.02, 0.06))
+
+    # ── Fire-and-forget: persist to session store (never blocks the UI) ───
+    # We only save successful responses, not error messages
+    if session_id and not displayed.startswith("⚠️"):
+        asyncio.create_task(_ss.save_message(session_id, message, displayed))
+
+    # Re-enable the input box at the end
+    yield gr.update(interactive=True), chat_history
+
+
+custom_css = """
+/* Aggressively force height: auto and min-height: 40px on the chatbot and flex containers */
+.gradio-container, .flex, .block, #chatbot-window {
+    height: auto !important;
+    min-height: 40px !important;
+}
+
+/* Ensure the chatbot doesn't overflow the viewport if it gets too full */
+#chatbot-window {
+    max-height: 70vh !important;
+    border: none !important;
+}
+
+/* Aggressively hide the footer, including HF injected footers if inside the container */
+footer, .footer, footer * {
+    display: none !important;
+    visibility: hidden !important;
+    height: 0 !important;
+    margin: 0 !important;
+    padding: 0 !important;
+}
+"""
+
+# JS: runs immediately on page load — generates/loads session_id from localStorage
+# and restores previous chat history. Completely non-blocking.
+_SESSION_JS = """
+async () => {
+    // ── Session ID: generate once, persist forever in localStorage ──
+    let sid = localStorage.getItem('martech_session_id');
+    if (!sid) {
+        sid = 'sess-' + Date.now() + '-' + Math.random().toString(36).slice(2, 9);
+        localStorage.setItem('martech_session_id', sid);
+    }
+    // Write the session_id into the hidden Gradio textbox
+    const el = document.getElementById('session-id-box')?.querySelector('textarea');
+    if (el) { el.value = sid; el.dispatchEvent(new Event('input', {bubbles:true})); }
+    return sid;
+}
+"""
+
+with gr.Blocks(title="Martechsol Assistant", theme=gr.themes.Soft(), css=custom_css) as demo:
+    gr.Markdown("# Martechsol Assistant")
+    gr.Markdown("Welcome! How can I help you today?")
+    
+    chatbot = gr.Chatbot(
+        show_label=False,
+        elem_id="chatbot-window",
+        render_markdown=True,
+    )
+    with gr.Row():
+        msg = gr.Textbox(
+            placeholder="Type your question here...",
+            show_label=False,
+            scale=9
+        )
+        send = gr.Button("Send", variant="primary", scale=1)
+    
+    clear = gr.Button("Clear Chat History")
+
+    # Hidden textbox holds the session_id — invisible to the user
+    session_id = gr.Textbox(
+        value="",
+        visible=False,
+        elem_id="session-id-box",
+        label="session_id",
+    )
+
+    # On load: run JS to set session_id from localStorage (non-blocking)
+    demo.load(fn=None, inputs=None, outputs=session_id, js=_SESSION_JS)
+
+    # Wire up the events — streaming generator for live typing effect (UNCHANGED)
+    send.click(chat_fn, inputs=[msg, chatbot, session_id], outputs=[msg, chatbot])
+    msg.submit(chat_fn, inputs=[msg, chatbot, session_id], outputs=[msg, chatbot])
+    clear.click(lambda: [], None, chatbot)
+
+if __name__ == "__main__":
+    demo.launch(server_name="0.0.0.0", server_port=7860, show_api=False)

backup_2026-05-04/docker-compose.yml

@@ -0,0 +1,14 @@
+version: "3.9"
+services:
+  rag-api:
+    build: .
+    container_name: rag-api
+    ports:
+      - "8000:8000"
+    env_file:
+      - .env
+    volumes:
+      - ./docs:/app/docs
+      - ./data/index:/app/data/index
+      - ./data/sessions:/app/data/sessions
+    restart: unless-stopped

backup_2026-05-04/docs/MartechSol_Employee_HandBook (7) (1).pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a48b14cc28d7892ae03a5dfe06a244832e2807ce178ca1f1acdbc58d6af4e8ef
+size 3844502

backup_2026-05-04/docs/MartechSol_Employee_Handbook_Extracted.txt

@@ -0,0 +1,1091 @@
+Employee Handbook 
+Last Modified: September 1st, 2024
+
+Contents 
+Introduction ....................................................................................................... 4 
+Workplace Orientation ....................................................................................... 4 
+Employment Status .......................................................................................... 5 
+Employment At Will .......................................................................................... 5 
+Employee Responsibilities ........................................................................................ 5 
+Workweek and Workday .................................................................................... 5 
+Time Clocks and Time Cards ............................................................................... 5 
+General Attendance Requirements ....................................................................... 6 
+Work from Home .............................................................................................. 6 
+Problem Resolution ........................................................................................... 7 
+Personal Appearance ......................................................................................... 7 
+Health Safety .................................................................................................. 7 
+Employee Relationships ..................................................................................... 8 
+Policy Against Harassment ................................................................................. 8 
+Activity Permission ........................................................................................... 9 
+Confidentiality ................................................................................................ 9 
+Intangible Property ......................................................................................... 10 
+Restraint of Trade, Non-Compete, and Cooling Off Period ....................................... 11 
+Solicitation ................................................................................................... 11 
+Cell Phone Usage ........................................................................................... 12 
+Computer, E-Mail and Internet Policy  ................................................................. 12 
+Tobacco Use .................................................................................................. 13 
+Grievance Procedure ....................................................................................... 13 
+Copyright Violation ......................................................................................... 13 
+Data Theft .................................................................................................... 13 
+Separation from the Company .......................................................................... 14 
+Exit Interviews .............................................................................................. 14 
+Final Settlement ............................................................................................. 14 
+Return of Property .......................................................................................... 15 
+
+
+Acceptability ................................................................................................. 15 
+Work Rules ................................................................................................... 15 
+Level 1 Actions .............................................................................................. 16 
+Level 2 Actions .............................................................................................. 16 
+Level 3 Actions .............................................................................................. 17 
+Disciplinary Procedures ..................................................................................... 18 
+Employee Benefits ................................................................................................. 18 
+Referral Program ............................................................................................ 18 
+Game Room .................................................................................................. 18 
+Holidays and Holiday Pay ................................................................................. 18 
+Pay Period and Paychecks ................................................................................ 19 
+Leaves ......................................................................................................... 19 
+Sick Leaves ................................................................................................... 19 
+Casual Leaves ............................................................................................... 20 
+Annual Leaves ............................................................................................... 21 
+Hajj Leave .................................................................................................... 22 
+Maternity Leave ............................................................................................. 23 
+Paternity Leave .............................................................................................. 23 
+Bereavement Leave ........................................................................................ 24 
+Unauthorized Leaves ....................................................................................... 24 
+Unapproved Absence Without Pay ..................................................................... 25 
+Leave Encashment ......................................................................................... 25 
+Other Benefits ..................................................................................................... 25 
+Loans & Advance Salary .................................................................................. 25 
+Maternity (Pregnancy) Benefit .......................................................................... 26 
+Company Maintained Vehicle ............................................................................ 27 
+Healthcare Insurance – For Self & Spouse ............................................................ 27 
+EOBI: .......................................................................................................... 30 
+Provident Fund: ............................................................................................. 30 
+
+
+Introduction 
+We are providing you this employee handbook to introduce you to our policies. The handbook will 
+describe some of the more important employee benefits and obligations. 
+Our business is constantly changing, and therefore MartechSol reserves the right to change all of our 
+policies, including those covered in this handbook, at any time. You will be informed of any changes 
+in policy through posting on portal or through other appropriate means. If you are uncertain about 
+any policy or procedure, please check with your Supervising Authority. 
+Workplace Orientation 
+Orientati
+on Training and Initial Evaluation Period 
+All employees will receive orientation training at the beginning of employment with MartechSol. This 
+period of orientation will include familiarization with Logicose’s work policies, disciplinary policies, job 
+duties, and reporting responsibilities. 
+Upon completion of orientation, all employees will undergo evaluation during the first ninety (90) 
+calendar days of employment. If performance is unsatisfactory for any reason during this period of time, 
+the employee may be immediately dismissed from employment. At the end of this 90-day period, the 
+employee’s Supervising Authority will determine if the employee’s performance warrants continued 
+employment. 
+If the employee’s performance is not up to the Supervising Authority’s expectations in terms of quality of 
+work, output, behavior, or any other performance indicator, the employee will not be confirmed for 
+further employment at the company after this 90-day period. It is also up to the Supervising Authority to 
+end the probation period at any point before 90 days and either confirm or terminate the employee. 
+The Supervising Authority is required to make a decision regarding the confirmation of an employee after 
+90 days. If the Supervising Authority requires more time to evaluate an employee further, (s)he has the 
+right extend the probation period. 
+Confirmation 
+If performance exceeds expectations, an employee may receive a salary increment upon confirmation. 
+The date of confirmation depends on date of joining and performance. Revised salaries for employees 
+that are confirmed before the 15th of a given month will be effective from the 1st of that same month. On 
+the other hand, revised salaries will be effective from the 1st of the following month for employees that 
+are confirmed after the 15th of a given month. For example, if someone is confirmed on the 10th of April, 
+the revised salary will be effective from the 1st April, however if they are confirmed on the 16th of April, 
+the revised salary will be effective from the 1st of May.  
+Casual and sick leaves will also be assigned on a pro-rata basis based on this calculation. 
+
+
+Employment Status 
+A “regular full-time employee” is any employee who is employed to work on a year-round basis, and who 
+is regularly scheduled to work their full shift hours. 
+Employment At Will 
+All employees are employed on an "at-will" basis. This means that employees are not employed for any 
+specific term or period of time, and that the employer may terminate the employment relationship at 
+any time for any reason. Similarly, employees may resign and terminate employment with MartechSol 
+at any time and for any reason with prior notice of 30-90 days depending on their role within the 
+organization. 
+N
+o employee has any authority to change the nature of this relationship through any statements, 
+representations, or conduct. The at-will relationship may be changed only through written and signed 
+authorization of the Supervising Authority. 
+Employee Responsibilities 
+Workweek and Workday 
+The nor
+mal workweek shall be considered full shift hours, six days per week, from 9:00 a.m. to 5:30 p.m. 
+The first Saturday of every month is off and the remaining three Saturday’s in each month are six and a 
+half hours (half-day). One hour is allocated for lunch/dinner in all shifts. 
+ Morning Shift: 1:30 pm - 2:30 pm
+ Evening Shift: 9:30 pm - 10:30 pm
+Smoking Breaks: There are a maximum of 3 breaks allowed in a workday (other than lunch/dinner 
+break). These breaks are not to be longer than 5 minutes. 
+If any other break is required, the employee is to contact his or her Supervising Authority for approval. 
+Time Clocks and Time Cards 
+All empl
+oyees shall use the portal to record their starting time and ending time. For wage payment 
+purposes, time worked will be figured to the nearest tenth of an hour. 
+Sharing login information (username and password) is strictly prohibited. Each person is to use their own 
+login information to time in at work. If any discrepancy is observed in the time in or time out process, 
+harsh disciplinary action will be taken against the person or persons involved. 
+In case an employee forgets to time in or is unable to time in, they are to submit a trouble ticket to the 
+Human Resources department. It is the employee’s responsibility to maintain their time sheet accurately. 
+Monthly salary will be calculated according to the time sheet. 
+Employees who want to change their work shift should contact their Supervising Authority for approval. 
+Necessary paperwork and legitimate reason are required for the shift change process. The decision to 
+change the shift of an employee is at the discretion of the Supervising Authority. 
+
+
+General Attendance Requirements 
+Regular and pro
+mpt attendance of employees is essential to our business. Employees who cannot meet 
+our attendance requirements will be subject to counseling and disciplinary action. Excessive absenteeism 
+or tardiness will result in termination of employment. The Supervisor has the authority to mark a half 
+day, day off, or full day at his/her discretion. 
+ Late Coming: Late coming is permitted till 20 minutes from your shift start time. If you arrive
+after 20 minutes of your shift start time, then it will be considered as a late arrival. 4 late arrivals
+in a month will be considered as a half day off. In addition, an employee is to inform his/her
+Supervising Authority if they will be more than 30 minutes late to work.
+ Early Out: If you need to leave before your shift ends, verbal approval is mandatory from your
+Supervising Authority. There will be no deductions for early out.
+ Half Day: Half day will be marked if you arrive 2 hours after your shift start time. If you complete
+less than six and a half hours on any given day, then it will also be considered as a half day off.
+ Full Day: Employees who spend less than 2 hours at work on any workday will be marked absent
+that day.
+ Employees who are late to work on any given workday are still responsible to complete all the 
+work assigned to them. If they are unable to, they should contact their Supervising Authority  
+immediately. If an employee arrives at work after 1 hour of their shift start time, by default, 
+the 8.5 hours shift has to be completed. If an employee is more than 1 hour late and wants 
+ to 
+leave early (without completing the total (8.5 hr) shift time), he/she has to contact their 
+Supervising Authority for approval.
+ For 
+employees who are unable to complete at least 50% of their work during a workday, the
+Supervising Authority reserves the right to decide the status of the workday (full day, off day,
+half day) is at his or her discretion.
+Work from Home 
+In case o
+f emergency (bad weather, temporary disability, unrest in city, etc) when employees cannot 
+reach work, they will be requested to work from home. In case an employee has personal valid reason(s) 
+as to why they cannot reach work, they can work from home requesting approval from their Supervising 
+Authority. The approval of this request is at the Supervising Authority’s discretion. 
+If less than 30% of the work has been completed, the day will be counted as a full day off. If 30-70% of 
+the work has been completed, it will be counted as a half day. If more than 70% of the work has been 
+completed, it will be counted as a full day. 
+Work can be submitted no later than 3 hours after the end of the employee’s regular shift timing. If the 
+work is not submitted within the given time, it will not be marked as work provided for the same day. If 
+an employee faces problems submitting their work within the given duration and wants to submit their 
+work later, approval is required from their Supervising Authority. 
+
+
+Problem Resolution 
+If an emplo
+yee faces difficulty or problems related to anything within the workplace, it is their 
+responsibility to submit a trouble ticket through the Portal. There is no need to contact the Supervising 
+Authority unless their ticket has not been addressed for more than 24 hours. 
+You are requested to use this trouble ticket system for your computer, admin and HR related 
+issues. How to use this system: 
+1. If you have any computer, admin, or HR related issue, go to the tickets link in the portal and
+select ‘Submit a ticket’.
+2. Select the concerned department for your problem e.g. if your mouse, keyboard, CPU or LCD is
+not working properly, please select Networking. If there is any issue with your attendance or
+payroll, select Human Resources. If there is any issue with fan, AC, kitchen item etc. please select
+Admin department.
+3. Once your trouble ticket is submitted, you may view the status of your ticket from ‘View open
+tickets’ link.
+As soon as your ticket is submitted, the Company will make every possible effort to resolve your issue on 
+an urgent basis. 
+There is also a messaging feature in this trouble ticket system. If there is any update related to your 
+ticket, you will receive a message within your open ticket. Similarly, if you want to send any message 
+related to your problem, you can also do that from ‘View open tickets’ section. 
+Once your issue is resolved, your ticket will be closed. You may view your closed tickets from ‘View your 
+closed tickets’ section. 
+This system will help resolve your issues quickly and will allow you to view status of your open tickets. 
+Personal Appearance 
+A company
+ is judged by its employees, as well as by its products and services. All employees are 
+expected to maintain good standards of personal neatness, including hair, clothes, and shoes. 
+Casual to business-style dress is appropriate. Employees should be neatly groomed and clothes should be 
+clean and in good condition. Leisure clothes such as cut-offs or halter tops are not acceptable attire for 
+the business office. 
+Health Safety 
+If an employee has had a contagious illness or serious health issue which may affect the health of other 
+employees (e.g. chicken pox, flu), a doctor’s written permission to return to work will be necessary. 
+
+
+Employee Relationships 
+MartechSol employs a number of people and, as a result, you will be working with people whose 
+personalities may differ from yours. It is your responsibility to get along with all of your co-workers. A 
+spirit of cooperation shown by all of us will help to accomplish our purpose of providing new 
+customers with the best possible service. 
+This does not mean that you need to become a personal friend of all your co-workers, but it does mean 
+that you should treat your co-workers with respect. Regardless of your personal opinions, your fellow 
+employee should be treated exactly as you would like to have that person treat you. 
+Senior employees should remember that they were once new employees and therefore should do 
+everything possible to aid new employees in acclimating themselves to their new jobs. 
+Policy 
+Against Harassment 
+MartechSol is committed to maintaining a work environment that is free of discrimination and 
+harassment. In keeping with this commitment, we will not tolerate harassment of our employees by 
+anyone, including any Supervising Authority, co-worker, vendor, client, or customer. 
+Harassment consists of unwelcome conduct, whether verbal, physical, or visual, that is based upon a 
+person’s protected status,  such as sex, color, race,  ancestry, religion, national origin, age, physical 
+handicap, medical condition, disability, marital status, veteran status, citizenship status, or other 
+protected group status. 
+MartechSol will not tolerate harassing conduct that affects tangible job benefits, that interferes 
+unreasonably with an individual’s work performance, or that creates an intimidating, hostile, or 
+offensive working environment. 
+Sexual harassment deserves special mention. Unwelcome sexual advances, requests for sexual favors, 
+and other physical, verbal, or visual conduct based on sex constitute sexual harassment when (1) 
+submission to the conduct is made a term or condition of employment, (2) submission to or rejection of 
+the conduct is used as the basis for an employment decision, or (3) the conduct has the purpose or effect 
+of unreasonably interfering with an individual’s work performance or creating an intimidating, hostile, or 
+offensive working environment. Sexual harassment may include explicit sexual proposition, sexual 
+innuendo, suggestive comments, sexually oriented “kidding” or “teasing,” “practical jokes,” jokes about 
+gender-specific traits, foul or obscene language or gestures, displays of foul or obscene printed or visual 
+material, and physical contact, such as patting, pinching, or brushing against another’s body. 
+All employees are responsible for helping to assure we avoid harassment. If you feel that you 
+have experienced or witnessed harassment, you should immediately notify your Supervising 
+Authority. MartechSol forbids retaliation against anyone who has reported harassment. 
+It is our policy to investigate all such complaints thoroughly and promptly. To the fullest extent 
+practicable, MartechSol will keep complaints and the terms of their resolution confidential. If an 
+investigation confirms that harassment has occurred, MartechSol will take appropriate corrective 
+action, including discipline up to and including immediate dismissal from employment. 
+
+
+Activity Permission 
+MartechSol is concerned with outside activities of employees only where such activities might involve a
+conflict of interest with Logicose’s best interests. A conflict of interest exists if an employee has a 
+private financial interest or other relationship outside MartechSol that is detrimental to the best
+interests of MartechSol.
+You shall not without prior written consent of the company, engage directly or indirectly, in any trade, 
+business or occupation or any other income generation activity. 
+If an employee desires to attend an academic institution during his/her employment, (s)he must receive 
+permission from the company by submitting relevant documentation. It is mandatory to fill the Activity 
+Permission form for approval. 
+An employee should discuss any possible conflict of interest with the HR Department as full disclosure 
+and open knowledge are essential. For the employee’s own protection, written approval should be 
+obtained in all cases where a possible conflict of interest is involved. 
+Other possible conflict of interest situations may include any type of “moonlighting work” or a second 
+job, which interferes with the employee’s work for MartechSol, any type of external business
+relationship with MartechSol, any of its competitors or any of its customers, and any type of public
+activity which may affect adversely on MartechSol.
+Confidentiality 
+MartechSol is a service provider that creates, completes, and delivers work for clients that do not want
+our involvement disclosed in their projects. The ownership of the work we create for our clients is 
+transferred over to them and they hold the copyright to the work delivered. Disclosing such work may 
+result in Copyright Infringement, so it is in your, and the company’s best interest, to not share 
+involvement in such work. 
+Moreover, employees are prohibited from maintaining records of confidential information or intellectual 
+property on personal e-mail accounts, computers, hard drives, smart phones, cloud, or online. 
+Both during employment with MartechSol and after separation, employees are not permitted to
+disclose to any third party or share any confidential information that is made available to you. 
+Confidential information includes, but is not limited to: 
+ Web copy, eBooks, Press Releases, Reports, Infographics, Articles, Blogs, and/or any copy that was 
+created or revised for clients while employed at MartechSol is the property of either the clients or 
+MartechSol. Disclosing involvement in such projects to those outside the company, mentioning it 
+on your CV or resume, and/or making public your involvement in such projects is prohibited.
+ Search Engine Optimization strategy, campaigns, processes, proposals, accounts for posting, list 
+of clients, contact information of clients, content created or revised for client is confidential 
+information. Mentioning your involvement and/or disclosing such information to those outside 
+the company or on your CV or resume is considered breach of policy.
+ Client Information, leads, pricing strategy, proposals, account information, portal information,
+samples, and promotional campaigns are the intellectual property of MartechSol. They may
+neither be disclosed nor shared with those outside the organization.
+
+
+ Sensitive company information, such as employee contact details, software code, promotional
+campaigns, client list, project(s) details, performance evaluation system, and in-house software.
+ Any and all such information is either Logicose’s or its Client’s intellectual property.
+Immediately upon termination of employment, or at any other time upon the company’s request, all 
+employees will return to the Company: 
+ All memoranda, notes and data, and computer software and hardware, records or other
+data/documents compiled by the employee or made available to the employee during the
+employee’s employment with the company concerning the business of the company, its
+affiliates, or their customers.
+ All other Confidential Information that is disclosed to you during employment.
+ All physical and intellectual property of the company or its affiliates, including without limitation,
+all the content, information, plans, files, records, documents, lists, equipment, supplies,
+promotional materials, keys, vehicles, and similar items and all copies thereof or extracts there
+from.
+Disclosure of such information while employed or after separation from MartechSol is unethical, and
+such actions will be considered intellectual property theft. 
+Furthermore, you cannot claim ownership of any project or developed content/material in any manner.  
+For example, giving a reference on your CV to a specific website for which you developed content while 
+working at the Company is prohibited. Any project or client details relating to your work carried out at 
+this company cannot be mentioned on your CV. 
+Intangible Property 
+During your course of employment with MartechSol, you will come across information that is privy to 
+those outside the organization. Such information is the intellectual (intangible) property of the company. 
+You may not at any time, during or after employment with MartechSol, have or claim any right, title, or 
+interest in any trade name, trademark, patent, copyright, work for hire, or other similar rights belonging 
+to or used by the company and shall not have or claim any right, title, or interest in any material or 
+matter of any sort prepared for or used in connection with the business or promotion of the company, 
+whatever  your involvement with such matters may have been, and whether procured, produced, 
+prepared, or published in whole or in part by you. 
+MartechSol, or its clients, have and will retain the sole and exclusive rights in any and all such trade
+names, trademarks, patents, copyrights, material, and matter unless transferred over to a third party. 
+Any and all documents, software, or copy that was created for MartechSol, its clients, or its affiliate
+brand names, is the intellectual property of the company or its clients. You may not claim ownership, 
+maintain personal records of, or disclose your involvement in the creation or modification of such 
+information, software, or projects. 
+
+
+Restraint of Trade, Non-Compete, and Cooling Off Period 
+Any current or separated employee is prohibited from incorporating a new company or starting a new 
+business in the same industry before the time of at least 24 months. 
+Employee shall not, on his or her own behalf or behalf of others, hold any ownership interest in any 
+business engaged in the following industries: 
+ Copywriting
+ Online Marketing
+ SEO
+ SMO
+ Ghostwriting
+ Industries that MartechSol, or any of its brand names, are currently or in the process of operating in
+Employee agrees and covenants that the use of sensitive and confidential information that is made available, 
+in certain circumstances, may cause irreparable damage to MartechSol and its reputation. Therefore,
+employee shall not until the expiration of two years after the termination of the employment,
+through any corporations or associates in any business, form a business that is directly competitive with 
+Company for a period of two years. 
+Since the region or territory in which MartechSol operates is based online, the jurisdiction of the
+restraint of trade is not limited to a specific city, state, or country. Forming an organization that is based 
+in any city MartechSol operates in, and/or creation of an online business is a breach of policy.
+Failure to comply with activity permission, restraint of trade, confidentiality, intangible property, non- 
+disclosure, and non-compete will result in immediate termination. The Company also reserves the right 
+to take appropriate legal action upon breach of policy both during employment and after separation. 
+Solicitation 
+Both during employment with the company and for a period of two (2) years following the termination/
+resignation of employment with the company at any time and for any reason, employee’s will not, directly 
+or indirectly, on the employee’s own behalf or on behalf of any other person or entity, hire or solicit to 
+hire for employment or consulting other provision of services, any person who is actively employed or 
+engaged (or in the preceding six months was actively employed or engaged) by MartechSol.
+This includes, but is not limited to, inducting or attempting to induce, or influencing or attempting to 
+influence, any person employed or engaged by the company to terminate his or her relationship with the 
+company. MartechSol reserves the right to take appropriate legal action against solicitation of employees.
+Furthermore, both during the employee’s employment and after separation from the company at any 
+time and for any reason, the employee will not directly or indirectly, on the employee’s own behalf of 
+any other person or entity, solicit the business of any Customer or any other entity with which 
+MartechSol has worked with or discussed the possibility of any work, at the time of employee’s
+termination, to provide services to such entity (a “Contractor”). Client information is confidential, and 
+MartechSol reserves the right to take legal action upon disclosure of privy information.
+
+
+Cell Phone Usage 
+Emp
+loyees shall not use cell phones for personal purposes while engaged in work activities. If the 
+employee needs to use the cell phone for important personal reasons, the employee shall excuse 
+themselves from the premises. Keep your cell phone on silent/vibrate. Use it responsibly, and make sure 
+that you do not disturb others while answering your calls. 
+Computer, E-Mail and Internet Policy 
+MartechSol maintains certain policy requirements for use of its “electronic communication systems.” 
+“Electronic communication systems” include computers, file servers, electronic information storage 
+systems, internal and external electronic mail systems, voice mail systems, local area networks and 
+any other system or technology used now or in the future by MartechSol to store or transmit data of 
+any kind electronically. 
+Our
+ policy requires the following: 
+1. Employees shall use the electronic communications systems for business purposes.
+2. Logicose’s electronic communications systems and all information transmitted or received by, or 
+stored or contained in, these systems are the property of MartechSol. No employee shall have 
+any property rights in or expectation of privacy for any information, even if of a personal nature, 
+communicated or received through Logicose’s electronic communications systems. MartechSol 
+may review, delete and copy any such information without first obtaining the consent of the 
+employee who created, sent or received the information. No employee, including system 
+administrators and Supervising Authority, shall use any electronic communications systems for 
+purposes of satisfying idle curiosity about the affairs of others. There must be a business purpose 
+for obtaining access to the files or communications of others.
+3. No employee shall use the electronic communications systems in a manner that constitutes a
+violation of provincial or federal law or that is offensive to others.
+4. Due to the threat to system stability posed by computer viruses and system incompatibility, no
+employee shall install or download software from the Internet or elsewhere on his or her
+computer without the supervision of the office administrator.
+If you have any questions about the policy or its administration, please contact your Supervising 
+Authority. Violations of the policy may result in disciplinary action up to and including termination. 
+USBs cannot be used on any office computer. If necessary, please contact the System Administrator. 
+The completion of assigned work is the employee’s responsibility. If an employee has any issues 
+regarding their PC or internet, they are to raise a trouble ticket immediately. 
+The use of the following is prohibited: 
+ Social media websites (e.g. Facebook)
+ Chatting websites (e.g. Meebo)
+ Chatting applications (e.g. MSN Messenger, Skype)
+ Online gaming websites (e.g. miniclips.com)
+ E-mail sites (e.g. Hotmail)
+
+
+ Political Websites
+ Pornography
+Tobacco Use 
+MartechSol maintains a smoke-free workplace for all of its employees, which is why smoking is 
+prohibited in the workplace. Employees who must smoke are encouraged to do so away from Company 
+property and during work and/or meal breaks only. 
+Grievance 
+Procedure 
+MartechSol has a grievance procedure to make sure that problems and complaints an employee has 
+concerning his or her treatment or working conditions is called to our attention. This does not 
+include computer-related issues or similar technical issues. For such problems, the trouble ticket 
+system is provided. Employees with a problem should take the following steps: 
+1. Explai
+n the problem to your immediate Supervising Authority. Allow 48 hours for an answer.
+2. If you are still not satisfied, put your grievance in writing and submit it to MartechSol President via 
+the Feedback Form on the Portal. If possible, a decision will be given within three working days.
+Copyright Violation 
+Any work performed within the premises of MartechSol for its clients, employees, or the Company itself 
+is under the sole ownership of MartechSol or those that the company transfers the rights to. Employees 
+cannot claim ownership of this work or use it outside company premises for other purposes, this 
+includes creating personal records on computers or e-mail accounts that aren’t the property of 
+MartechSol. Employees cannot use this work as reference to anyone else either, unless they get written 
+consent from MartechSol. Listed below are some examples of copyright violation: 
+Showing, sharing, using, creating a personal record of, or claiming ownership or involvement in the 
+creation of: 
+ Co
+py written
+ Software developed
+ Client contact information
+ Payments received at MartechSol
+ In
+tellectual property
+Data Theft 
+Any data relating to MartechSol, its clients, or employees is under the sole ownership of MartechSol. 
+Employees cannot use or transmit this data, as it is not under their ownership. Employees cannot use 
+this data as reference either. 
+Archiving such work on external hard drives, online, cloud, and/or on computers that are not property 
+of MartechSol is a breach of policy. 
+
+
+Separation from the Company 
+ Prio
+r to Confirmation:
+o Minimum one day notice period, or as communicated in the offer letter, is required
+during probationary period on behalf of the employee.
+o If employee performance/behavior is not up to Company expectations, then the
+Supervising Authority has the right to end the probation period and terminate the
+employee.
+ After Confirmation:
+o The employment relationship may be terminated either by you or by the company with a
+prior written notice of one month or salary in lieu thereof, unless mentioned below. It is,
+however, understood that no notice is required in case your services are terminated on
+grounds of misconduct, willful neglect of duty, breach of trust or any other dereliction of
+duty or misdemeanor prejudicial to the interest of the company. It is further understood
+that any financial indebtedness of yours, standing to the detriment of the company’s
+prestige will amount to a very serious misdemeanor towards the company
+o A minimum notice period of at least 30 days is to served unless listed below otherwise:
+Managerial Roles 
+Vice Team Lead 30 days 
+Team Lead 60 days 
+Group Team Lead 90 days 
+Exit Interviews 
+All employees separating from MartechSol must complete an exit interview with their immediate 
+supervisor. An exit interview gives the Human Resource Department the opportunity to obtain feedback 
+from employees as they transition out of their positions. 
+Final Settlement 
+All employees must undergo a final settlement before they separate from the organization. All 
+adjustments will be made according to below mentioned procedures: 
+ Bef
+ore Salary is Processed: 
+If any employee resigns before the salary is processed of any given month, their adjustments
+(loans, advances, pro-rata leaves, etc.) will be made in the same month and the salary will be
+deposited along with the rest of the employees. The remaining amount of the following month’s
+salary will be processed as per the payroll process. No adjustments will be made in the following
+salary except for early exit. For example, someone resigns on the 20th of April and his last working
+day is the 20th of May, the adjustments will be made in the month of April’s salary. The salary for
+the remaining days of the notice period to be served in May will be processed with May’s payroll
+with Early Exit deduction of 11 days (21st May-31st May).
+ After/At the time Salary is Processed:
+If any employee resigns once the salary is processed of any given month, their adjustments (loans,
+advances, pro-rata leaves, etc.) will be made in the following month and the salary will be
+deposited along with the rest of the employees. For example, someone resigns on 25th of April and
+
+
+his last working day is on the 25th of May, the adjustments will be made in the month of May’s 
+salary.  
+Return of Property 
+Employees who separate from MartechSol service must return all issued property such as identification 
+cards, health insurance card, company maintained vehicle, and intellectual property of the organization. 
+Acceptability 
+Any changes in Policies, Rules, and Code of Conduct will first be shared through the MartechSol Portal. 
+A reasonable period of time will be allotted to discuss suggestions and amendments in changes before 
+its implementation. 
+Timing In to work after date of implementation implies that you understand and will abide by 
+organization policy. 
+Work 
+Rules 
+Any work performed within the premises of MartechSol is under the Company’s ownership and/or its 
+clients. Employees cannot claim ownership of any work done in or for MartechSol, neither can they use 
+it in the future. 
+All work performed at MartechSol has to be done in a legal and ethical manner so there is never 
+any copyright violation. 
+Employees shall perform their assignments within the specifics of the position description. Employees 
+who consistently fail to conform to the specifics of their position description or exhibit inappropriate 
+behavior or poor performance shall be required to meet with their supervisor. 
+This meeting will attempt to identify the problems, find ways to improve the situation and suggest 
+adequate solutions, concluding with a recommended course of action and an appropriate time frame 
+in which the employee will be expected to improve to the satisfaction of MartechSol. Details of the 
+meeting will be documented, signed by all parties as a correct representation of points discussed and 
+placed in the employee’s personal file. 
+Disciplinary action and corrective measures are taken at the discretion of the Management at 
+MartechSol. The possible steps for disciplinary action are: 
+1. Co
+unseling/Verbal Warning
+2. One or more formal written warnings through email
+3. Issuance of Notice
+4. Suspension
+5. Dismissal
+The choice of options depends on the seriousness of the behavior. Exceptions or deviations from the 
+progressive discipline sequence may occur whenever the Supervising Authority, in conjunction with the 
+President/Director, deems that circumstances warrant. 
+For level 1 offense, discussions between the employee and his or her supervisor will occur to allow the 
+employee to correct the situation. When a warning notice is issued, it becomes a part of an employee's 
+
+
+record and is considered when evaluating an employee for promotion, transfer, training or additional 
+discipline. Various offenses have been divided into different levels according to severity. 
+Three warning notices within twelve (12) months’ time, regardless of the type of level offense, will result 
+in discharge. 
+Level 1 Actions 
+These actions are taken for behaviors such as: 
+ Unautho
+rized or excessive absence, tardiness or early timing out
+ Unauthorized time away from work station
+ Slowing or interfering with the work of other employees
+ Failure to notify supervisor of incompletion of assigned work before leaving
+ Obscene, abusive, harassing, or disruptive language or behavior
+ Failure to perform assigned job responsibilities
+ Failure to follow prescribed work procedures
+ Failure to notify supervisor of absences
+ Neglect of organization property
+ Excessive personal use of cell telephone and/or email
+ Work shift not completed
+Procedure For Dealing With Level 1 Behavior: These procedures are at the discretion of the Supervising 
+Authority. 
+ Counseling/Verbal warning
+ Formal written warning in the form of email
+ Issuance of notice
+ Suspension
+Level 2 Actions 
+These are more serious and must be dealt with firmly and immediately. Typical behaviors in this level 
+include: 
+ Reoccurrin
+g tardiness without reasonable explanation
+ Absences without approved leave
+ Refusal to comply with instructions of a supervisor
+ Conduct endangering the safety of the employee, co-workers or members
+ Working when ability is impaired by the use of alcohol, and/or illegal drugs
+ Unscheduled leaving from the workplace without informing supervisor
+ Habitual sleeping during work hours
+ Unauthorized use of organization materials and supplies
+ Fighting or threatening violence in the workplace
+ Unauthorized possession of weapons on organization property
+
+
+ Knowingly timing in another employee
+ Sharing portal login info
+ Inappropriate usage of internet, or any usage of internet unrelated to work during work hours
+ Harassing or bullying coworkers
+Procedure for dealing with Level 2 behavior: These procedures are at the discretion of the Supervising 
+Authority. 
+ Issuance of Notice
+ Suspension or probation
+ Termination
+Level 3 Actions 
+These are b
+ehaviors that are serious enough to justify either a suspension or, in extreme situations, 
+termination of employment without following the preceding disciplinary steps. Behaviors for which 
+immediate termination can be justified include, but are not limited to, the following: 
+ Sexual harassment
+ Involvement in any income-generating activity without the consent of supervising authority
+ Insubordination, or the refusal to comply with the specific instructions of a supervisor in the
+context of an assigned job duty
+ Falsification of personnel records, time records, or any other organization documents and records
+ Fighting during work time or on work premises
+ Use of, or possession of, alcohol or illegal drugs during work time or on work property
+ Damaging, defacing, or misusing organization property or the property of coworkers
+ Theft, misappropriation, embezzlement, unauthorized possession or removal of organization
+property or the property of employees or customers
+ Immoral or indecent conduct which occurs on organization property
+ Possession of explosives, firearms, or other dangerous weapons on work premises
+ Failure to report an absence for a three-day period without a satisfactory explanation
+ Unauthorized release of work-related data or information
+ Continued unsatisfactory job performance
+ Violation of the organization's conflict of interest/ethical standards
+ Data theft: Stealing any digital or other type of data (e.g. email, company records, client records) 
+which belongs to MartechSol.
+ Copyright violation: Showing ownership of specific work performed at MartechSol. Discussion 
+of clients, websites, revenue generated, payments, or any work-related details outside the 
+Company’s premises.
+ Ot
+her behaviors that, in the opinion of the Supervising Authority, seriously threaten the well-
+being of co-workers.
+In case of any ambiguity, please contact your supervising authority. 
+
+
+Procedure for dealing with Level 3 behavior: These procedures are at the discretion of the Supervising 
+Authority. 
+ Suspension
+ Termination
+Disciplinary Procedures 
+MartechSol may use progressive discipline as a means of enforcing minor violations of the work rules.
+Progressive discipline may include steps such as counseling, written warning, and suspension. 
+Depending on the nature of the misconduct and the position involved, steps in the process may be 
+omitted or employment may be immediately terminated. The decision whether to apply progressive 
+discipline in any particular situation will rest within the sole discretion of management. 
+Examples of misconduct which will usually result in immediate discharge include theft, fighting or 
+physical assault, insubordination, dishonesty, falsification of time cards, production records, or other 
+Company documents, possession of alcohol or illegal drugs in the workplace, and disloyalty or breach of 
+confidentiality. This list is not intended to limit our right to discharge in other situations when we believe 
+termination of employment is appropriate. 
+Employee Benefits 
+Referral Program 
+Any employ
+ee can benefit from the referral program by referring qualified friends or acquaintances. 
+The employee who has referred an individual is eligible for a PKR. 5,000 bonus once the new 
+candidate joins the organization. 
+Game Room 
+In order to promote a relaxed environment and provide employees with more forms of 
+entertainment, MartechSol has set up a game room in Room 301.
+This game ro
+om is accessible during lunchtime, so the morning shift has access to it from 1:30-2:30 pm 
+and the evening/night shift has access from 9:00-10:00pm. The game room can also be used after work. 
+Females are to use the game room on Monday, Wednesday, and Friday during lunchtime. Males should 
+use the game room on Tuesday, Thursday, and Saturday during lunch hour. 
+Holidays and Holiday Pay 
+MartechSol observes all Federal holidays as paid holidays. Due to our nature of work, employees 
+may be asked to work on specific holidays, according to their availability. They will be awarded 
+compensatory leave allowance or compensatory leave (employee’s choice), which they can utilize at
+their convenience.  
+To qualify for holiday pay, an employee must have worked his or her regularly scheduled shift on the 
+day preceding the holiday and must work his or her regularly scheduled shift on the day following the 
+holiday. 
+
+
+Pay Period and Paychecks 
+For pay c
+alculation purposes, the workweek (or “pay period”) will commence 12:01 a.m. on Sunday 
+morning and end at 12:00 p.m. on Saturday evening. Employees will be paid monthly on (payday), for the 
+preceding month. If payday falls on a holiday, then paychecks will be provided the day before the 
+holiday. 
+Employees are expected to immediately report any mistakes in their paychecks. Underpayments will be 
+corrected as soon as possible. If it is not practical to issue an employee a new paycheck to correct any 
+overpayment, the overpayment will be deducted from the employee's next paycheck. 
+Salary deduction for days off will be on “per-day” basis. {(Gross Salary x 12) / 365}. 
+Payroll for June and December 
+The salary for June and December will be processed and transferred during the first week of July and 
+January respectively. This is to ensure that the transition from the current to the revised salary is smooth 
+and all adjustments for the preceding month are processed correctly.  
+Leaves 
+Prior to Confirmation: 
+ No leaves are allowed prior to your confirmation.
+ In case you skip a day, you will be marked absent, and your salary will be deducted for the day.
+ Prior approval from your supervising authority is required for situations where you would be
+unable to come into work.
+ If you are absent from work as a result of sickness or any other unforeseeable personal matter,
+you are required to notify your supervisory authority or the HR department by telephone or SMS
+within two hours of your scheduled shift starting time.
+After Confirmation: 
+Sick Leaves 
+Definition: 
+Sick Leave is defined as the period of time an employee is absent from work with full pay as a 
+result of an illness or injury. 
+Policy: 
+ All full time confirmed employees are entitled for a maximum of 8 days of sick leave per annum.
+ Sick leaves cannot be carried forward to the next year and neither can they be encashed.
+ Each year on the 1st of January, your leave account will be credited with the sick leave
+entitlement.
+ If anyone is confirmed in MartechSol during the year, then his/her sick leave entitlement will be 
+on a pro-rata basis.
+ In case of separation from the company during the year, sick leave availed will be adjusted on
+
+
+pro- rata basis from your final salary payment.
+ If an employee takes sick leave from work starting any day of the week, any weekend or holiday
+that falls in between will be counted as a full day sick leave.
+ Sick leave availed in excess of entitlement will be treated as casual or annual leave (if available
+and subject to approval from reporting authority); incase of insufficient casual/annual leave
+balance, excess sick leave will be treated as unpaid leave.
+ During notice period, no sick leave will be entertained even if the leave shows credit balance.
+Process and Documentation:
+ Planned appointments, surgery, or any medical instance which can be deemed as anticipated is
+subject to prior approval from your supervising authority.
+ If you are absent from work as a result of sickness or injury, you are required to notify your
+supervisory authority or HR department by telephone or SMS within two hours of your
+scheduled shift starting time (or before if possible). Failure to comply with the process may result
+in absent without leave.
+ You must apply for sick leave immediately after returning from your sick leave by submitting
+your leave application to the HR department after approval from your supervising authority.
+ The submission of a medical certificate or relevant documentation when applying for a sick leave
+is mandatory, the leave will be considered absent without pay if proper documentation is not
+submitted.
+ Sick leave can only be availed when sick and cannot be claimed for other purposes. Falsifying
+information or using sick leave for a purpose other than illness or injury will make you liable for
+disciplinary action.
+Casual Leaves 
+Definition: 
+Casual leaves may be availed by employees in cases of urgent or unforeseen contingencies. 
+These cases include, but are not limited to, situations which may arise on account of unforeseen 
+circumstances e.g. birth/illness/death in the immediate family or of a close relative. 
+Any personal reason that prevents you from coming into work can be used for your casual leave. 
+Policy: 
+ All full time confirmed employees are entitled for a maximum of 10 days casual leave per annum.
+ Casual leaves cannot be carried forward to the next year.
+ Casual leaves that have not been exhausted over the calendar year will be subject to encashment
+with the paycheck of the following month.
+ Each year on the 1st of January, your leave account will be credited with the casual leave
+entitlement if eligible.
+ If anyone is confirmed in MartechSol during the year, then his/her casual leave entitlement will 
+be on a pro-rata basis.
+ In case of separation from the company during the year, casual leave availed will be adjusted on
+
+
+pro-rata basis from your final salary payment.
+ If an employee takes casual leave from work starting any day of the week, any weekend or
+holiday that falls in between will be counted as a full day casual leave.
+ Casual leave cannot be taken for 3 consecutive days at any given time. If leave availed is for or in
+excess of 3 days, the entire period will be treated as unpaid leave. However, if circumstances
+warrant, the department head may approve the first 3 days to be treated as casual leave, and
+only the additional days to be treated as annual leaves (if available).
+ Employees can take up to 2 consecutive casual leaves. If the number of casual leaves is 3 or
+more, the whole duration will be treated as unpaid automatically unless approved by the line
+manager.
+ In case of any urgent requirement, your reporting authority may ask you to report to work during
+your casual leave.
+ Combining casual leave with a weekly holiday or a public holiday shall be inadmissible and that
+additional leave shall be adjusted as leave without pay. For example, if a public holiday falls on
+Friday and any employee takes leave on Saturday, all three days will be counted as casual leave.
+ During notice period, no casual leave will be allowed even if the leave shows credit balance.
+Documentation and Process: 
+ If you are absent from work as a result of any urgent personal responsibilities or any
+unforeseeable circumstances, you are required to notify your supervisory authority or HR
+department by telephone or SMS within two hours of your scheduled shift starting time (or
+before if possible). Failure to comply with the process may result in absent without leave.
+ You must apply for casual leave immediately after returning from your casual leave by submitting
+your leave application to the HR department after approval from your supervising authority.
+ In cases of planned or known circumstances, an employee must apply for casual leave to the
+immediate supervisor for approval in advance.
+Annual Leaves 
+Definition: 
+The purpose of annual leave is to provide employees with a reasonable period of rest and 
+a significant break from the workplace in order to maintain a healthy work life balance. 
+Policy: 
+ All Full-time confirmed employee(s) shall be entitled to 14 days paid annual leave after
+completion of one year of service.
+ Annuals leaves are not subject to encashment, except for TL roles or greater and for the Sales &
+Support Department.
+ Up to 7 annual leaves can be carried forward to the next year, if approved by supervising
+authority, for the following reasons: 
+ Marriage
+ Obligation outside the country (Hajj, Residence Visa Process, etc.)
+ Or for any planned reason that warrants extended leave. 
+
+
+ Carried forward annual leaves can’t be carried forward for more than a year. 
+ If any employee completes one year of service at MartechSol during the calendar year, then his/
+her annual leave entitlement will be on a pro-rata basis for that year.
+ In case of separation from the company during the year, annual leave availed will be adjusted on
+pro-rata basis from your final salary payment.
+ Annual leave may be availed at one time during the year or may be divided and availed at various
+times during the year, subject to approval.
+ Annual leaves will be granted in keeping with the operational exigencies of the organization, and
+will be scheduled by the supervisor to meet the requirements of individual employees as far as
+possible.
+ Management reserves the right to refuse a leave request, allow a partial request, revoke
+approval if already granted, and/or to recall an employee before expiry of the leave period.
+ If you are hospitalized during your annual leave and produce a valid medical certificate stating
+the fact, then these days will be adjusted as sick leave (if available).
+ If an employee takes annual leave from work starting any day of the week, any weekend or
+holiday that falls in between will be counted as an annual leave.
+ During notice period, no annual leave will be allowed even if the leave shows credit balance.
+Documentation and Process: 
+ A completed leave application form is to be submitted for approval in advance to the HR
+department prior to the anticipated start of the leave accordingly:
+Number of leaves Approval time required 
+1-3 days Before 2 days 
+4-7 days Before 1 week 
+More than 7 days Before 1 month 
+ An employee who wishes to obtain annual leaves shall apply in writing to HR in advance before
+the commencement of leaves.
+ If the leave request is refused or postponed on account of company exigencies, the fact of such
+refusal or postponement and reasons thereto shall be conveyed to the employee concerned.
+ If the requested leave is granted the employee will proceed on his leave on the approved date.
+ If an employee remains absent beyond the approved period of leave, he shall be liable for
+disciplinary action unless the employee has justifiable reasons for absenteeism.
+ Annual leaves may only be availed after prior approval has been granted, however in case of an
+emergency, annual leaves may be entertained subject to your supervising authority’s discretion.
+Hajj Leave 
+Definition: 
+Employees who wish to make their pilgrimage to Mecca during Dhu'l Hijja may do so during 
+their tenure at MartechSol. These leaves are separate from the employee's annual leaves or any 
+other leave which he/she is entitled to. 
+
+
+Policy: 
+ All full time permanent employees with 4 years of service are entitled for paid Hajj Leave for 10
+days.
+ Any leaves beyond 10 days needs to come from your annual or casual leaves.
+ Hajj leave will be granted only once during the whole employment period.
+
+Documentation and Process: 
+ Your leave application must be submitted three months in advance for the necessary approval.
+ Copy of your Hajj Passport/Visa needs to be submitted to HR.
+Maternity Leave 
+Definition: 
+A period of approved absence for female employees that wish to continue employment 
+at MartechSol after delivery, granted for the purpose of giving birth and taking care of 
+newborn children. 
+Policy: 
+ All full-time female employees shall be entitled to 90 days paid maternity leave, taken no later
+than two weeks before the expected delivery date and is only applicable after completion of one
+year of service.
+ This entitlement shall be available only twice during the entire period of service.
+ Premature birth shall be considered as maternity leave. In case of still birth, female employee
+shall be entitled to 30 days paid maternity leave.
+Documentation and Process: 
+ Maternity Leave form needs to be submitted and approved five months before planned
+maternity leave.
+
+Paternity Leave 
+Definition: 
+A period of approved absence for male employees granted after or shortly before the birth of his 
+child. 
+Policy: 
+ All full-time male employees are entitled to 3 days paid paternity leave.
+ This entitlement shall be available only twice during the entire period of service.
+
+
+
+ Male employees may combine other leaves with paternity leave subject to approval from
+supervising authority. 
+ Premature birth shall be considered as paternity leave. In case of still birth, male employee shall
+be entitled to up to 3 days paid paternity leave.
+Documentation and Process: 
+ Application for paternity leave should be submitted to HR department at least two months in
+advance supported by the gynecologist’s certification.
+Bereavement Leave 
+Definition: 
+Bereavement leaves are paid leaves for employees that cover absences related to the death of 
+immediate family members. 
+   Policy: 
+ All full-time employee(s) shall be entitled to 3 days paid bereavement leave.
+ Bereavement leave will normally be granted unless there are unusual business needs or staffing
+requirements. An employee may, with his or her supervisor’s approval, use any available leaves
+for additional time off as necessary. 
+   Documentation and Process: 
+ You must apply for bereavement leave immediately after returning from your leave by
+submitting your leave application to the HR department after approval from your supervising
+authority.
+Unauthorized Leaves 
+ Any
+ absence without prior approval from your reporting authority will be considered as an
+unauthorized leave.
+ All unauthorized and/or unreported absences shall be considered Absences without Leave,
+(AWOL). Each unauthorized leave will result in a disciplinary notice and will be added in your file.
+3 unauthorized leaves in a quarter will result in a severe disciplinary action.
+ In case you were not able to inform your reporting authority due to some unavoidable reasons,
+you may discuss it with your reporting authority later. Based on discretion, he/she may authorize
+your leave.
+ For employees serving their probationary period, failure to communicate with the respective
+authority for more than 3 consecutive days of leave will result in termination.
+ For permanent employees, failure to communicate with the respective authority for more than 7
+consecutive days of leave will result in termination.
+
+
+Unapproved Absence Without Pay 
+Definition: 
+Any leave, in excess of the 10 Casual leaves that you are entitled to, is an Absence without Pay. 
+These leaves, when taken without prior approval from your supervising authority are considered 
+Unapproved Absence without Pay. 
+Policy:
+ 
+ Unapproved Absence without Pay will result in salary deduction(s) per day absent.
+ Taking more than two consecutive Absences without Pay prior to the weekend will result in salary
+deduction for the weekend. For example, if an employee is absent on Thursday, Friday, and
+Saturday then Sunday will also be marked absent. In other words, employees must report to work
+on the last working day of the week to avoid further deductions. 
+Leave Encashment 
+Each employee is entitled to a number of Sick, Casual, Annual, and other leaves. However, only Casual 
+leaves are subject to encashment for specific departments. 
+Listed below is breakdown of Department eligibility of leave encashment: 
+Department Casual Annual 
+Copywriting Yes No 
+SEO Yes No 
+Sales Yes Yes 
+Software Yes No 
+Networking Yes No 
+Human Resources Yes No 
+Admin Yes No 
+Other Benefits 
+Loans & Advance Salary 
+Definition: 
+The purpose of loans and advance salary is to meet an emergency need that can’t be 
+accommodated through other financial arrangements. Only genuine emergency needs such as 
+extraordinary medical costs not covered by insurance, or any other extreme financial or medical 
+emergency will be considered. The decision to approve or reject a loan/advance salary request will 
+be taken by a 3-person committee which will comprise of line manager/head of department, a 
+representative from HR, and a representative from finance.  
+Policy: 
+ Decisions regarding loan requests will be relayed within 3 to 7 working days. For extremely urgent
+matters, the committee will take a decision within 27 hours of request sent.
+ The decision of the committee will be final and non-negotiable.
+ A loans/advance salary can only be taken once in 6 months.
+
+
+ If an employee has an ongoing loan/advance salary, he/she will not be allowed to avail another
+loan/advance salary.
+ Repayment period is up to 6 months.
+ Loan amount can’t exceed 3 months’ salary.
+ Advance salary amount shall not exceed from your monthly salary.
+Documentation & Process: 
+ If possible, the loan/advance salary form should be submitted at least a week (7 days) before it is
+required.
+ The form can be acquired from HR and must be completed including all the signatures required.
+ The necessary documentation & supporting documents should be provided along with the filled
+form.
+Maternity (Pregnancy) Benefit 
+Definition: 
+This benefit provides financial assistance to female and male employees to cover the cost of childbirth and 
+other delivery related expenses. 
+Policy: 
+ Male and female employees that have completed at least one year of service can avail maternity
+benefit of PKR 50,000.
+ Maternity benefit can be utilized twice during tenure at MartechSol.
+ This benefit also covers stillbirth.
+Documentation & Process: 
+ Maternity Benefit Form and relevant documentation must be provided at least 60 days before
+expected delivery.
+ Employees will be awarded this benefit a week before date of expected delivery.
+ In case of premature delivery, employees can either contact Supervising Authority or Admin
+Department to arrange the benefit urgently or they may pay out of pocket at the time and avail the
+benefit when they rejoin the office.
+
+
+Company Maintained Vehicle 
+Definition: 
+MartechSol provides company maintained cars to employees at certain designation levels. The 
+policy varies across different departments. The company maintained car will be owned and 
+maintained by the company for the use of the employee. 
+Policy: 
+ Employees should drive their allotted vehicle in a safe and responsible vehicle. They must abide by
+driving laws.
+ Scheduled maintenance will be carried out by the company after every 5,000 KMs or 3 months
+(whichever comes first).
+ Employees are requested to keep a copy of the following documents in the company vehicle:
+o Authority Letter
+o Motor Vehicle Tax paper
+o Insurance paper
+o Copy of the first page of the vehicle’s registration book
+Documentation & Process: 
+ Prior to vehicle allocation, employee must provide a copy of valid driving license of self (or driver)
+for company record.
+ All maintenance and wear & tear requests need to be made through submitting a ticket on portal or
+by contacting Admin Department.
+ In case of an accident:
+o All accidents must be reported to the Admin Department.
+o If the company vehicle is stolen, report the theft immediately to the local police and to the
+Admin Department. Obtain a copy of the police report filed.
+Healthcare Insurance – For Self & Spouse 
+Health care benefits are provided to all full-time employees and their spouse. Complete details of this 
+program are provided below: 
+ “ANNEXURE A” 
+PROCEDURE FOR UTILIZATION OF HOSPITALIZATION EXPENSE BENEFIT 
+Emergency Hospitalization 
+In case of emergency, approach the nearest hospital. In case it is a PANEL HOSPITAL 
+1. Identify yourself as an NJI insured.
+2. Produce Health Card / Letter of Authority
+3. Get the treatment
+4. Get the treatment on credit, up to the limits available.
+5. Pay only the amount that exceeds the entitlement, if any, before discharge.
+
+
+In case it is a NON-PANEL HOSPITAL 
+1. Inform NJI within 24 hours of the hospitalization.
+2. Pay cash for the treatment.
+3. Submit all original bills /supporting documents* with  our  claim  form  for  reimbursement,
+within 30 days of discharge from the hospital.
+4. Settlement of claim will be done in line of the policy terms.
+ “ANNEXURE B” 
+PROCEDURE FOR UTILIZATION OF HOSPITALIZATION EXPENSE BENEFIT 
+Emergency Hospitalization 
+If hospitalization is advised by a licensed physician 
+ In case it is a PANEL HOSPITAL 
+1. Approach any of our panel hospital with our Letter of Authority / Health Card
+2. Identify yourself as an NJI insured
+3. Get the treatment on credit, up to the limits available. 
+4. Pay only the amount that exceeds the entitlement, if any, before discharge.
+In case it is a NON-PANEL HOSPITAL 
+1. Send us the cost estimate from the concerned doctor of the treatment with details, for prior
+approval.
+2. Get the treatment and pay cash for the treatment.
+3. Submit all original bills /supporting documents* including our approval letter with our claim
+form for reimbursement, within 30 days of discharge from the hospital.
+4. Settlement of claim will be done in line of prior approval given and other policy terms.
+*Supporting Documents:
+ Duly completed original NJI Claim Form
+ Original itemized bill/invoice (breakup of charged) on hospital
+bill-book
+ Discharge card / clinical summary
+ Copy of NJI card or letter of admission
+ Diagnostic reports
+ Doctors prescriptions
+ Original pharmacy vouchers
+ Original payment receipts
+
+
+JUBILEE GENERAL INSURANCE COMPANY LTD 
+GROUP HEALTHCARE INSURANCE PROPOSAL FOR 
+MartechSol
+Hospitalization & Related Benefits 
+Plan A Plan B Plan C Plan D 
+H&R Limits (Per Person / Per Year) Rs.500,000 Rs.400,000 Rs.300,000 Rs.150,000 
+Room & Board  (per day) Rs.16,360 Rs.6,720 Rs.6,720 Rs.1,800 
+Per Hospitalization 
+Pre-Hospitalization Sub Limit (Diagnosis, 30 Days 30 Days 30 Days 30 Days 
+Consultation, & Medicines) 
+Post-Hospitalization Sub Limit (Follow-Ups) 30 Days 30 Days 30 Days 30 Days 
+Daycare Surgeries & Specialized 
+Investigations In Outpatient Settings 
+Including but not limited to: 
+COVERED 
+Dialysis, Cataract Surgery, MRI, CT Scan, 
+Endoscopy, Thallium Scan, Angiography, Treatment 
+of Fractures, Local Road Ambulance for 
+Emergencies only, Emergency Dental Treatment 
+due to accidental injuries within 48 hours (for pain 
+relief only). 
+       Plan A Presidential Layer 
+       Plan B Associate Managers, Managers & Senior Managers 
+       Plan C Executives, Senior Executives & Assistant Managers 
+       Plan D Office Boys & Other Support Staff 
+ Send us the cost estimate from the concerned doctor of the treatment with details, for prior
+approval. Get the treatment and pay cash for the treatment.
+ Submit all original bills /supporting documents* including our approval letter with our claim form
+for reimbursement, within 30 days of discharge from the hospital.
+ Settlement of claim will be done in line of prior approval given and other policy terms.
+Supporting documents  
+Itemized hospital bill 
+Discharge card/clinical summary 
+Diagnostic reports 
+Prescriptions 
+Payment receipts 
+
+
+EOBI 
+Employee Old Age Benefit Income is a benefit provided to all full-time employees upon confirmation. 
+The sole purpose of EOBI is to provide compulsory social insurance to employees. It extends following 
+benefits to insured persons or their survivors: 
+• Old-Age Pension
+• Survivor's Pension
+• Invalidity Pension
+• Old-Age Grant  
+RATES:
+• 1- Employer's Contribution @ 5 % of the worker's minimum wages (i.e. Rs. 8000) - Rs. 400/= Per
+Month
+• 2- Employee's Contribution @ 1 % of the worker's minimum wages (i.e. Rs.8000) - Rs. 80/= Per
+Month
+Provident Fund 
+Provident Fund is an investment/ saving fund contributed to - by employees & employers, out of which a 
+lump sum amount is provided to each employee on retirement. This benefit is provided to all full time, 
+confirmed employees. 
+Click Here To View PF Policies in Detail 
+
+

backup_2026-05-04/floaitng-icon/KhloeSAC.lottie

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:532a144eeea5a1a6e49ab22ae4c0dc4f94e12cf8540e3514f1bc676d929eeac2
+size 462684

backup_2026-05-04/get_models.py

@@ -0,0 +1,25 @@
+import asyncio
+import os
+import httpx
+from dotenv import load_dotenv
+
+load_dotenv()
+
+async def main():
+    api_key = os.getenv("GROQ_API_KEY")
+    if not api_key:
+        print("No API Key")
+        return
+    url = "https://api.groq.com/openai/v1/models"
+    headers = {"Authorization": f"Bearer {api_key}"}
+    async with httpx.AsyncClient() as client:
+        resp = await client.get(url, headers=headers)
+        if resp.status_code == 200:
+            models = resp.json().get("data", [])
+            for m in models:
+                if "deepseek" in m["id"].lower() or "qwen" in m["id"].lower():
+                    print(m["id"])
+        else:
+            print(resp.status_code, resp.text)
+
+asyncio.run(main())

backup_2026-05-04/requirements.txt

@@ -0,0 +1,14 @@
+fastapi
+uvicorn[standard]
+faiss-cpu
+sentence-transformers
+pydantic-settings
+pypdf
+python-dotenv
+numpy
+httpx
+gradio>=5.0.0
+python-multipart
+pandas
+openpyxl
+rank_bm25

backup_2026-05-04/static/addon.html

@@ -0,0 +1,543 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+<meta charset="UTF-8">
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
+<title>Martechsol Assistant Widget</title>
+<style>
+    /* Premium Design for Martechsol Assistant */
+    @import url('https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600&display=swap');
+
+    #martech-chat-wrapper {
+        font-family: 'Inter', -apple-system, BlinkMacSystemFont, sans-serif;
+    }
+
+    /* Floating Action Button (FAB) */
+    #martech-chat-fab {
+        position: fixed;
+        right: 10px;
+        bottom: 25px;
+        width: auto;
+        height: auto;
+        background: transparent;
+        border-radius: 50%;
+        display: flex;
+        align-items: center;
+        justify-content: center;
+        cursor: pointer;
+        z-index: 999999;
+        transition: transform 0.4s cubic-bezier(0.34, 1.56, 0.64, 1), background 0.3s ease, box-shadow 0.3s ease;
+        -webkit-tap-highlight-color: transparent;
+    }
+
+    #martech-chat-fab:hover {
+        transform: scale(1.1);
+    }
+
+    #martech-chat-fab.is-active {
+        background: #1e293b;
+        box-shadow: 0 10px 25px rgba(30, 41, 59, 0.4);
+        transform: scale(0.8);
+    }
+
+    /* Chat Window Styling */
+    #martech-chat-box {
+        position: fixed;
+        right: 25px;
+        bottom: 100px;
+        width: 400px;
+        height: 550px;
+        background: #ffffff;
+        border-radius: 16px;
+        overflow: hidden;
+        display: none;
+        flex-direction: column;
+        box-shadow: 0 12px 50px rgba(0, 0, 0, 0.2);
+        z-index: 999998;
+        border: 1px solid #e2e8f0;
+        opacity: 0;
+        transform: translateY(20px);
+        transition: opacity 0.3s ease, transform 0.3s cubic-bezier(0.34, 1.56, 0.64, 1);
+    }
+
+    #martech-chat-box.is-visible {
+        display: flex;
+        opacity: 1;
+        transform: translateY(0);
+    }
+
+    #martech-chat-header {
+        background: #ffffff;
+        padding: 16px 20px;
+        border-bottom: 1px solid #f1f5f9;
+        display: flex;
+        align-items: center;
+        gap: 12px;
+    }
+
+    @keyframes pulse-dot {
+        0% { transform: scale(1); box-shadow: 0 0 0 0 rgba(16, 185, 129, 0.7); }
+        70% { transform: scale(1.1); box-shadow: 0 0 0 10px rgba(16, 185, 129, 0); }
+        100% { transform: scale(1); box-shadow: 0 0 0 0 rgba(16, 185, 129, 0); }
+    }
+
+    #martech-chat-header .dot {
+        width: 10px;
+        height: 10px;
+        background: #10b981;
+        border-radius: 50%;
+        animation: pulse-dot 2s infinite;
+    }
+
+    #martech-chat-header span {
+        font-weight: 600;
+        color: #1e293b;
+        font-size: 15px;
+    }
+
+    /* Custom Chat Area Styling */
+    #chat-messages {
+        flex: 1;
+        overflow-y: auto;
+        padding: 16px;
+        display: flex;
+        flex-direction: column;
+        gap: 12px;
+        background: #f8fafc;
+        scroll-behavior: smooth;
+    }
+
+    /* Custom Scrollbar for messages */
+    #chat-messages::-webkit-scrollbar { width: 6px; }
+    #chat-messages::-webkit-scrollbar-track { background: transparent; }
+    #chat-messages::-webkit-scrollbar-thumb { background: #cbd5e1; border-radius: 10px; }
+
+    .chat-message {
+        max-width: 85%;
+        padding: 12px 16px;
+        border-radius: 16px;
+        font-size: 14px;
+        line-height: 1.5;
+        word-wrap: break-word;
+        white-space: pre-wrap;
+    }
+
+    .chat-message.user {
+        align-self: flex-end;
+        background: #1e293b;
+        color: white;
+        border-bottom-right-radius: 4px;
+    }
+
+    .chat-message.bot {
+        align-self: flex-start;
+        background: #ffffff;
+        color: #334155;
+        border-bottom-left-radius: 4px;
+        border: 1px solid #e2e8f0;
+        box-shadow: 0 2px 4px rgba(0,0,0,0.02);
+    }
+
+    /* Surgical Bolding & List Style */
+    .chat-message b {
+        font-weight: 800;
+        color: #0f172a;
+    }
+    .chat-message.user b {
+        color: #ffffff;
+    }
+
+    #chat-input-area {
+        padding: 16px;
+        background: #ffffff;
+        border-top: 1px solid #f1f5f9;
+        display: flex;
+        gap: 8px;
+        align-items: center;
+    }
+
+    #chat-input {
+        flex: 1;
+        border: 1px solid #e2e8f0;
+        border-radius: 20px;
+        padding: 12px 16px;
+        font-size: 14px;
+        outline: none;
+        transition: border-color 0.2s;
+        font-family: inherit;
+        box-shadow: inset 0 1px 2px rgba(0,0,0,0.02);
+    }
+
+    #chat-input:focus {
+        border-color: #10b981;
+    }
+
+    #chat-input:disabled {
+        background: #f1f5f9;
+        cursor: not-allowed;
+    }
+
+    #chat-send {
+        background: #10b981;
+        color: white;
+        border: none;
+        width: 44px;
+        height: 44px;
+        border-radius: 50%;
+        display: flex;
+        align-items: center;
+        justify-content: center;
+        cursor: pointer;
+        transition: background 0.2s, transform 0.1s;
+    }
+
+    #chat-send:hover {
+        background: #059669;
+    }
+
+    #chat-send:active {
+        transform: scale(0.95);
+    }
+
+    #chat-send:disabled {
+        background: #cbd5e1;
+        cursor: not-allowed;
+        transform: none;
+    }
+
+    /* Loading / Typing Animation */
+    .typing-indicator {
+        display: flex;
+        gap: 4px;
+        padding: 4px 2px;
+        align-items: center;
+        height: 18px;
+    }
+    .typing-indicator span {
+        width: 6px;
+        height: 6px;
+        background: #94a3b8;
+        border-radius: 50%;
+        animation: typing-dots 1.4s infinite ease-in-out both;
+    }
+    .typing-indicator span:nth-child(1) { animation-delay: -0.32s; }
+    .typing-indicator span:nth-child(2) { animation-delay: -0.16s; }
+    @keyframes typing-dots {
+        0%, 80%, 100% { transform: scale(0); }
+        40% { transform: scale(1); }
+    }
+
+    @media (max-width: 480px) {
+        #martech-chat-box {
+            right: 15px;
+            bottom: 100px;
+            width: calc(100vw - 30px);
+            height: 70vh;
+        }
+    }
+</style>
+</head>
+<body>
+
+<!-- Lottie Player Script -->
+<script src="https://unpkg.com/@dotlottie/player-component@latest/dist/dotlottie-player.mjs" type="module"></script>
+
+<div id="martech-chat-wrapper">
+    <div id="martech-chat-fab">
+        <!-- Animated Chatbot Icon -->
+        <div id="chat-icon" style="width: 233px; height: 238px; display: flex; align-items: center; justify-content: center; pointer-events: none;">
+            <dotlottie-player
+                src="https://joedown11-chatrag.hf.space/static/bot-icon.lottie"
+                background="transparent" speed="1" style="width: 100%; height: 100%; will-change: transform;" loop autoplay>
+            </dotlottie-player>
+        </div>
+        <!-- Close Icon -->
+        <svg id="close-icon" viewBox="0 0 24 24" style="display:none; width: 60px; height: 60px;">
+            <path d="M19 6.41L17.59 5 12 10.59 6.41 5 5 6.41 10.59 12 5 17.59 6.41 19 12 13.41 17.59 19 19 17.59 13.41 12z" fill="white" />
+        </svg>
+    </div>
+
+    <div id="martech-chat-box">
+        <div id="martech-chat-header">
+            <div class="dot"></div>
+            <span>Martechsol Assistant</span>
+        </div>
+        
+        <!-- Custom Chat UI replacing iframe -->
+        <div id="chat-messages">
+            <div class="chat-message bot">Welcome! How can I help you today?</div>
+        </div>
+        
+        <div id="chat-input-area">
+            <input type="text" id="chat-input" placeholder="Type your question here..." autocomplete="off" />
+            <button id="chat-send" title="Send">
+                <!-- Send Icon -->
+                <svg width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
+                    <line x1="22" y1="2" x2="11" y2="13"></line>
+                    <polygon points="22 2 15 22 11 13 2 9 22 2"></polygon>
+                </svg>
+            </button>
+        </div>
+    </div>
+</div>
+
+<script>
+(function () {
+    // UI Elements
+    const fab = document.getElementById('martech-chat-fab');
+    const box = document.getElementById('martech-chat-box');
+    const chatIcon = document.getElementById('chat-icon');
+    const closeIcon = document.getElementById('close-icon');
+    const messagesContainer = document.getElementById('chat-messages');
+    const inputField = document.getElementById('chat-input');
+    const sendButton = document.getElementById('chat-send');
+
+    // FAB Toggle Logic
+    fab.addEventListener('click', function () {
+        const isVisible = box.classList.contains('is-visible');
+        if (isVisible) {
+            box.classList.remove('is-visible');
+            setTimeout(() => { box.style.display = 'none'; }, 300);
+            chatIcon.style.display = 'block';
+            closeIcon.style.display = 'none';
+            fab.classList.remove('is-active');
+        } else {
+            box.style.display = 'flex';
+            setTimeout(() => { box.classList.add('is-visible'); inputField.focus(); }, 10);
+            chatIcon.style.display = 'none';
+            closeIcon.style.display = 'block';
+            fab.classList.add('is-active');
+        }
+    });
+
+    // Chat Logic
+    const API_URL = "https://joedown11-chatrag.hf.space/api/chat";
+    const BASE_URL = API_URL.replace("/api/chat", "");
+    let chatHistory = [];
+
+    // ── Session ID: generate once, persist in localStorage ──
+    let sessionId = localStorage.getItem('martech_session_id');
+    if (!sessionId) {
+        // Use a temporary name/id until we get the real one
+        sessionId = 'user-' + Date.now() + '-' + Math.random().toString(36).slice(2, 9);
+        localStorage.setItem('martech_session_id', sessionId);
+    }
+
+    function formatMessage(text) {
+        if (!text) return "";
+        // 1. Convert Markdown Bold to HTML Bold (safety)
+        let formatted = text.replace(/\*\*(.*?)\*\*/g, '<b>$1</b>');
+        // 2. Remove the '*' at the start of lines and use a bullet
+        formatted = formatted.replace(/^\* /gm, '• ');
+        // 3. Newlines to BR
+        return formatted.replace(/\n/g, '<br>');
+    }
+
+    function appendMessage(role, content) {
+        const div = document.createElement('div');
+        div.className = `chat-message ${role}`;
+        div.innerHTML = formatMessage(content);
+        messagesContainer.appendChild(div);
+        messagesContainer.scrollTop = messagesContainer.scrollHeight;
+        return div;
+    }
+
+    // ── User Integration & History ──────────────────────────────────────────
+    async function initUserSession() {
+        // 1. Discover User Name immediately (0.2s)
+        let userName = null;
+        try {
+            const storageKeys = ['userInfo', 'user', 'profile', 'auth', 'currentUser', 'account'];
+            for (const key of storageKeys) {
+                const stored = localStorage.getItem(key) || sessionStorage.getItem(key);
+                if (stored) {
+                    try {
+                        const parsed = JSON.parse(stored);
+                        userName = parsed.name || parsed.fullName || (parsed.user && parsed.user.name) || parsed.display_name;
+                        if (userName) break;
+                    } catch(err) {
+                        if (typeof stored === 'string' && stored.length < 50 && !stored.includes('{')) {
+                            userName = stored; break;
+                        }
+                    }
+                }
+            }
+        } catch (e) {}
+
+        if (!userName) {
+            try {
+                const pResp = await fetch("https://hrmmartechsol-ba71e8dc3fa2.herokuapp.com/api/users/profile", {
+                    credentials: 'include'
+                });
+                if (pResp.ok) {
+                    const pData = await pResp.json();
+                    userName = pData.name || (pData.personalDetails && pData.personalDetails.fullName);
+                }
+            } catch (e) {}
+        }
+
+        // Multi-user logic: if name changed, clear old session and start fresh
+        const lastKnownName = localStorage.getItem('martech_last_user_name');
+        if (userName && lastKnownName && userName !== lastKnownName) {
+            localStorage.removeItem('martech_session_id');
+            sessionId = 'user-' + Date.now() + '-' + Math.random().toString(36).slice(2, 9);
+            localStorage.setItem('martech_session_id', sessionId);
+            messagesContainer.innerHTML = '<div class="chat-message bot">Welcome! How can I help you today?</div>';
+        }
+        if (userName) {
+            localStorage.setItem('martech_last_user_name', userName);
+        }
+
+        // 2. Fetch history for this session
+        try {
+            const hResp = await fetch(BASE_URL + "/api/session/history/" + sessionId);
+            if (hResp.ok) {
+                const hData = await hResp.json();
+                if (hData.history && hData.history.length > 0) {
+                    messagesContainer.innerHTML = '';
+                    chatHistory = hData.history;
+                    chatHistory.forEach(m => {
+                        appendMessage(m.role === 'assistant' ? 'bot' : 'user', m.content);
+                    });
+                }
+            }
+        } catch (e) {}
+
+        // 3. Sync name with backend
+        if (userName) {
+            await fetch(BASE_URL + "/api/session/update-name", {
+                method: 'POST',
+                headers: { 'Content-Type': 'application/json' },
+                body: JSON.stringify({ session_id: sessionId, user_name: userName })
+            }).then(r => r.json()).then(rData => {
+                if (rData.new_session_id && rData.new_session_id !== sessionId) {
+                    sessionId = rData.new_session_id;
+                    localStorage.setItem('martech_session_id', sessionId);
+                }
+            }).catch(() => {});
+        }
+    }
+
+    initUserSession();
+
+    function showTypingIndicator() {
+        const div = document.createElement('div');
+        div.className = 'chat-message bot';
+        div.innerHTML = '<div class="typing-indicator"><span></span><span></span><span></span></div>';
+        messagesContainer.appendChild(div);
+        messagesContainer.scrollTop = messagesContainer.scrollHeight;
+        return div;
+    }
+
+    // Typo Configuration for Human-like Typing
+    const NEARBY_KEYS = {
+        'a': 'sqwz', 'b': 'vghn', 'c': 'xdfv', 'd': 'sfecx', 'e': 'wrsdf',
+        'f': 'dgrtcv', 'g': 'fhtybn', 'h': 'gjyunb', 'i': 'uojkl', 'j': 'hkunmi',
+        'k': 'jlomi', 'l': 'kop', 'm': 'njk', 'n': 'bhjm', 'o': 'ipkl',
+        'p': 'ol', 'q': 'wa', 'r': 'edft', 's': 'awedxz', 't': 'rfgy',
+        'u': 'yihj', 'v': 'cfgb', 'w': 'qase', 'x': 'zsdc', 'y': 'tghu',
+        'z': 'xas',
+    };
+    const TYPO_CHANCE = 0.07;
+
+    function getNearbyChar(ch) {
+        const lower = ch.toLowerCase();
+        if (NEARBY_KEYS[lower]) {
+            const options = NEARBY_KEYS[lower];
+            const replacement = options.charAt(Math.floor(Math.random() * options.length));
+            return ch === ch.toUpperCase() ? replacement.toUpperCase() : replacement;
+        }
+        const abc = "abcdefghijklmnopqrstuvwxyz";
+        return abc.charAt(Math.floor(Math.random() * abc.length));
+    }
+
+    const sleep = ms => new Promise(r => setTimeout(r, ms));
+
+    async function typeMessageWithTypos(element, text) {
+        const fullHtml = formatMessage(text);
+        
+        // Simple HTML-aware typing: split by tags
+        const tokens = fullHtml.split(/(<[^>]*>)/);
+        let currentHtml = "";
+        
+        for (const token of tokens) {
+            if (token.startsWith("<")) {
+                // Instantly add tags
+                currentHtml += token;
+                element.innerHTML = currentHtml;
+            } else {
+                // Type text content char by char
+                for (let char of token) {
+                    currentHtml += char;
+                    element.innerHTML = currentHtml;
+                    await sleep(Math.random() * 15 + 5);
+                }
+            }
+            messagesContainer.scrollTop = messagesContainer.scrollHeight;
+        }
+    }
+
+    async function handleSend() {
+        const text = inputField.value.trim();
+        if (!text) return;
+
+        // UI state lock
+        inputField.value = '';
+        inputField.disabled = true;
+        sendButton.disabled = true;
+
+        appendMessage('user', text);
+        const typingEl = showTypingIndicator();
+
+        try {
+            // Call the FastAPI Backend directly
+            const response = await fetch(API_URL, {
+                method: 'POST',
+                headers: { 'Content-Type': 'application/json' },
+                body: JSON.stringify({ 
+                    message: text, 
+                    history: chatHistory,
+                    session_id: sessionId
+                })
+            });
+
+            if (!response.ok) {
+                if (response.status === 429) throw new Error("Rate limit exceeded.");
+                throw new Error("Server error.");
+            }
+
+            const data = await response.json();
+            const reply = data.reply;
+
+            typingEl.remove();
+            const botEl = appendMessage('bot', '');
+
+            // Update local memory
+            chatHistory.push({ role: "user", content: text });
+            chatHistory.push({ role: "assistant", content: reply });
+
+            // Stream text out
+            await typeMessageWithTypos(botEl, reply);
+
+        } catch (error) {
+            console.error(error);
+            typingEl.remove();
+            appendMessage('bot', "⚠️ I'm sorry, I encountered an error. Please try again.");
+        } finally {
+            inputField.disabled = false;
+            sendButton.disabled = false;
+            inputField.focus();
+        }
+    }
+
+    // Event Listeners
+    sendButton.addEventListener('click', handleSend);
+    inputField.addEventListener('keypress', function(e) {
+        if (e.key === 'Enter') handleSend();
+    });
+
+})();
+</script>
+
+</body>
+</html>

backup_2026-05-04/static/bot-icon.lottie

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:532a144eeea5a1a6e49ab22ae4c0dc4f94e12cf8540e3514f1bc676d929eeac2
+size 462684

backup_2026-05-04/static/chat-loader.js

@@ -0,0 +1,48 @@
+/**
+ * Martechsol Assistant Loader
+ * Usage: <script src="https://joedown11-chatrag.hf.space/static/chat-loader.js"></script>
+ */
+(function() {
+    const baseUrl = 'https://joedown11-chatrag.hf.space';
+    
+    // Create container
+    const container = document.createElement('div');
+    container.id = 'martech-chat-widget-container';
+    document.body.appendChild(container);
+
+    // Fetch the addon HTML from the dedicated /widget endpoint
+    fetch(`${baseUrl}/widget?v=${Date.now()}`) // Cache busting
+        .then(response => response.text())
+        .then(html => {
+            // Create a temporary element to parse the HTML
+            const parser = new DOMParser();
+            const doc = parser.parseFromString(html, 'text/html');
+            
+            // 1. Extract and inject styles
+            doc.querySelectorAll('style').forEach(st => {
+                document.head.appendChild(st.cloneNode(true));
+            });
+
+            // 2. Extract and inject body content
+            const wrapper = doc.querySelector('#martech-chat-wrapper');
+            if (wrapper) {
+                container.innerHTML = wrapper.outerHTML;
+            } else {
+                // Fallback: just take the body content
+                container.innerHTML = doc.body.innerHTML;
+            }
+
+            // 3. Extract and execute scripts (critical for logic)
+            doc.querySelectorAll('script').forEach(oldScript => {
+                const newScript = document.createElement('script');
+                Array.from(oldScript.attributes).forEach(attr => {
+                    newScript.setAttribute(attr.name, attr.value);
+                });
+                newScript.innerHTML = oldScript.innerHTML;
+                document.body.appendChild(newScript);
+            });
+            
+            console.log("Martechsol Assistant Loaded Successfully");
+        })
+        .catch(err => console.error("Failed to load Martechsol Assistant:", err));
+})();

backup_2026-05-04/test_groq.py

@@ -0,0 +1,26 @@
+import asyncio
+import os
+import httpx
+from dotenv import load_dotenv
+
+load_dotenv()
+
+async def main():
+    api_key = os.getenv("GROQ_API_KEY")
+    url = "https://api.groq.com/openai/v1/chat/completions"
+    headers = {
+        "Authorization": f"Bearer {api_key}",
+        "Content-Type": "application/json"
+    }
+    payload = {
+        "model": "deepseek-r1-distill-llama-70b",
+        "temperature": 0.0,
+        "max_tokens": 1200,
+        "messages": [{"role": "system", "content": "hello"}, {"role": "user", "content": "test"}]
+    }
+    async with httpx.AsyncClient() as client:
+        resp = await client.post(url, headers=headers, json=payload)
+        print(resp.status_code)
+        print(resp.text)
+
+asyncio.run(main())

backup_2026-05-04/wordpress code/WP_INTEGRATION_SCRIPT.txt

@@ -0,0 +1,12 @@
+<!-- 
+Martechsol Chatbot Integration Script 
+Paste this snippet right before the closing </body> tag on your WordPress site.
+It will automatically load the UI and logic from your Hugging Face space.
+-->
+
+<script>
+fetch('https://joedown11-chatrag.hf.space/static/addon.html').then(r => r.text()).then(h => {
+    const d = document.createElement('div'); d.innerHTML = h; document.body.appendChild(d);
+    d.querySelectorAll('script').forEach(s => { const n = document.createElement('script'); Array.from(s.attributes).forEach(a => n.setAttribute(a.name, a.value)); n.innerHTML = s.innerHTML; document.body.appendChild(n); });
+});
+</script>

backup_2026-05-04/wordpress code/addon.html

@@ -0,0 +1,477 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+<meta charset="UTF-8">
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
+<title>Martechsol Assistant Widget</title>
+<style>
+    /* Premium Design for Martechsol Assistant */
+    @import url('https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600&display=swap');
+
+    #martech-chat-wrapper {
+        font-family: 'Inter', -apple-system, BlinkMacSystemFont, sans-serif;
+    }
+
+    /* Floating Action Button (FAB) */
+    #martech-chat-fab {
+        position: fixed;
+        right: 10px;
+        bottom: 25px;
+        width: auto;
+        height: auto;
+        background: transparent;
+        border-radius: 50%;
+        display: flex;
+        align-items: center;
+        justify-content: center;
+        cursor: pointer;
+        z-index: 999999;
+        transition: transform 0.4s cubic-bezier(0.34, 1.56, 0.64, 1), background 0.3s ease, box-shadow 0.3s ease;
+        -webkit-tap-highlight-color: transparent;
+    }
+
+    #martech-chat-fab:hover {
+        transform: scale(1.1);
+    }
+
+    #martech-chat-fab.is-active {
+        background: #1e293b;
+        box-shadow: 0 10px 25px rgba(30, 41, 59, 0.4);
+        transform: scale(0.8);
+    }
+
+    /* Chat Window Styling */
+    #martech-chat-box {
+        position: fixed;
+        right: 25px;
+        bottom: 100px;
+        width: 400px;
+        height: 550px;
+        background: #ffffff;
+        border-radius: 16px;
+        overflow: hidden;
+        display: none;
+        flex-direction: column;
+        box-shadow: 0 12px 50px rgba(0, 0, 0, 0.2);
+        z-index: 999998;
+        border: 1px solid #e2e8f0;
+        opacity: 0;
+        transform: translateY(20px);
+        transition: opacity 0.3s ease, transform 0.3s cubic-bezier(0.34, 1.56, 0.64, 1);
+    }
+
+    #martech-chat-box.is-visible {
+        display: flex;
+        opacity: 1;
+        transform: translateY(0);
+    }
+
+    #martech-chat-header {
+        background: #ffffff;
+        padding: 16px 20px;
+        border-bottom: 1px solid #f1f5f9;
+        display: flex;
+        align-items: center;
+        gap: 12px;
+    }
+
+    @keyframes pulse-dot {
+        0% { transform: scale(1); box-shadow: 0 0 0 0 rgba(16, 185, 129, 0.7); }
+        70% { transform: scale(1.1); box-shadow: 0 0 0 10px rgba(16, 185, 129, 0); }
+        100% { transform: scale(1); box-shadow: 0 0 0 0 rgba(16, 185, 129, 0); }
+    }
+
+    #martech-chat-header .dot {
+        width: 10px;
+        height: 10px;
+        background: #10b981;
+        border-radius: 50%;
+        animation: pulse-dot 2s infinite;
+    }
+
+    #martech-chat-header span {
+        font-weight: 600;
+        color: #1e293b;
+        font-size: 15px;
+    }
+
+    /* Custom Chat Area Styling */
+    #chat-messages {
+        flex: 1;
+        overflow-y: auto;
+        padding: 16px;
+        display: flex;
+        flex-direction: column;
+        gap: 12px;
+        background: #f8fafc;
+        scroll-behavior: smooth;
+    }
+
+    /* Custom Scrollbar for messages */
+    #chat-messages::-webkit-scrollbar { width: 6px; }
+    #chat-messages::-webkit-scrollbar-track { background: transparent; }
+    #chat-messages::-webkit-scrollbar-thumb { background: #cbd5e1; border-radius: 10px; }
+
+    .chat-message {
+        max-width: 85%;
+        padding: 12px 16px;
+        border-radius: 16px;
+        font-size: 14px;
+        line-height: 1.5;
+        word-wrap: break-word;
+        white-space: pre-wrap;
+    }
+
+    .chat-message.user {
+        align-self: flex-end;
+        background: #1e293b;
+        color: white;
+        border-bottom-right-radius: 4px;
+    }
+
+    .chat-message.bot {
+        align-self: flex-start;
+        background: #ffffff;
+        color: #334155;
+        border-bottom-left-radius: 4px;
+        border: 1px solid #e2e8f0;
+        box-shadow: 0 2px 4px rgba(0,0,0,0.02);
+    }
+
+    #chat-input-area {
+        padding: 16px;
+        background: #ffffff;
+        border-top: 1px solid #f1f5f9;
+        display: flex;
+        gap: 8px;
+        align-items: center;
+    }
+
+    #chat-input {
+        flex: 1;
+        border: 1px solid #e2e8f0;
+        border-radius: 20px;
+        padding: 12px 16px;
+        font-size: 14px;
+        outline: none;
+        transition: border-color 0.2s;
+        font-family: inherit;
+        box-shadow: inset 0 1px 2px rgba(0,0,0,0.02);
+    }
+
+    #chat-input:focus {
+        border-color: #10b981;
+    }
+
+    #chat-input:disabled {
+        background: #f1f5f9;
+        cursor: not-allowed;
+    }
+
+    #chat-send {
+        background: #10b981;
+        color: white;
+        border: none;
+        width: 44px;
+        height: 44px;
+        border-radius: 50%;
+        display: flex;
+        align-items: center;
+        justify-content: center;
+        cursor: pointer;
+        transition: background 0.2s, transform 0.1s;
+    }
+
+    #chat-send:hover {
+        background: #059669;
+    }
+
+    #chat-send:active {
+        transform: scale(0.95);
+    }
+
+    #chat-send:disabled {
+        background: #cbd5e1;
+        cursor: not-allowed;
+        transform: none;
+    }
+
+    /* Loading / Typing Animation */
+    .typing-indicator {
+        display: flex;
+        gap: 4px;
+        padding: 4px 2px;
+        align-items: center;
+        height: 18px;
+    }
+    .typing-indicator span {
+        width: 6px;
+        height: 6px;
+        background: #94a3b8;
+        border-radius: 50%;
+        animation: typing-dots 1.4s infinite ease-in-out both;
+    }
+    .typing-indicator span:nth-child(1) { animation-delay: -0.32s; }
+    .typing-indicator span:nth-child(2) { animation-delay: -0.16s; }
+    @keyframes typing-dots {
+        0%, 80%, 100% { transform: scale(0); }
+        40% { transform: scale(1); }
+    }
+
+    @media (max-width: 480px) {
+        #martech-chat-box {
+            right: 15px;
+            bottom: 100px;
+            width: calc(100vw - 30px);
+            height: 70vh;
+        }
+    }
+</style>
+</head>
+<body>
+
+<!-- Lottie Player Script -->
+<script src="https://unpkg.com/@dotlottie/player-component@latest/dist/dotlottie-player.mjs" type="module"></script>
+
+<div id="martech-chat-wrapper">
+    <div id="martech-chat-fab">
+        <!-- Animated Chatbot Icon -->
+        <div id="chat-icon" style="width: 233px; height: 238px; display: flex; align-items: center; justify-content: center; pointer-events: none;">
+            <dotlottie-player
+                src="https://seashell-cattle-543014.hostingersite.com/wp-content/uploads/2026/04/KhloeSAC.lottie"
+                background="transparent" speed="1" style="width: 100%; height: 100%; will-change: transform;" loop autoplay>
+            </dotlottie-player>
+        </div>
+        <!-- Close Icon -->
+        <svg id="close-icon" viewBox="0 0 24 24" style="display:none; width: 60px; height: 60px;">
+            <path d="M19 6.41L17.59 5 12 10.59 6.41 5 5 6.41 10.59 12 5 17.59 6.41 19 12 13.41 17.59 19 19 17.59 13.41 12z" fill="white" />
+        </svg>
+    </div>
+
+    <div id="martech-chat-box">
+        <div id="martech-chat-header">
+            <div class="dot"></div>
+            <span>Martechsol Assistant</span>
+        </div>
+        
+        <!-- Custom Chat UI replacing iframe -->
+        <div id="chat-messages">
+            <div class="chat-message bot">Welcome! How can I help you today?</div>
+        </div>
+        
+        <div id="chat-input-area">
+            <input type="text" id="chat-input" placeholder="Type your question here..." autocomplete="off" />
+            <button id="chat-send" title="Send">
+                <!-- Send Icon -->
+                <svg width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
+                    <line x1="22" y1="2" x2="11" y2="13"></line>
+                    <polygon points="22 2 15 22 11 13 2 9 22 2"></polygon>
+                </svg>
+            </button>
+        </div>
+    </div>
+</div>
+
+<script>
+(function () {
+    // UI Elements
+    const fab = document.getElementById('martech-chat-fab');
+    const box = document.getElementById('martech-chat-box');
+    const chatIcon = document.getElementById('chat-icon');
+    const closeIcon = document.getElementById('close-icon');
+    const messagesContainer = document.getElementById('chat-messages');
+    const inputField = document.getElementById('chat-input');
+    const sendButton = document.getElementById('chat-send');
+
+    // FAB Toggle Logic
+    fab.addEventListener('click', function () {
+        const isVisible = box.classList.contains('is-visible');
+        if (isVisible) {
+            box.classList.remove('is-visible');
+            setTimeout(() => { box.style.display = 'none'; }, 300);
+            chatIcon.style.display = 'block';
+            closeIcon.style.display = 'none';
+            fab.classList.remove('is-active');
+        } else {
+            box.style.display = 'flex';
+            setTimeout(() => { box.classList.add('is-visible'); inputField.focus(); }, 10);
+            chatIcon.style.display = 'none';
+            closeIcon.style.display = 'block';
+            fab.classList.add('is-active');
+        }
+    });
+
+    // Chat Logic
+    const API_URL = "https://joedown11-chatrag.hf.space/api/chat";
+    let chatHistory = [];
+
+    // ── Session ID: generate once, persist in localStorage ──
+    let sessionId = localStorage.getItem('martech_session_id');
+    if (!sessionId) {
+        sessionId = 'sess-' + Date.now() + '-' + Math.random().toString(36).slice(2, 9);
+        localStorage.setItem('martech_session_id', sessionId);
+    }
+
+    function appendMessage(role, content) {
+        const div = document.createElement('div');
+        div.className = `chat-message ${role}`;
+        div.textContent = content;
+        messagesContainer.appendChild(div);
+        messagesContainer.scrollTop = messagesContainer.scrollHeight;
+        return div;
+    }
+
+    function showTypingIndicator() {
+        const div = document.createElement('div');
+        div.className = 'chat-message bot';
+        div.innerHTML = '<div class="typing-indicator"><span></span><span></span><span></span></div>';
+        messagesContainer.appendChild(div);
+        messagesContainer.scrollTop = messagesContainer.scrollHeight;
+        return div;
+    }
+
+    // Typo Configuration for Human-like Typing
+    const NEARBY_KEYS = {
+        'a': 'sqwz', 'b': 'vghn', 'c': 'xdfv', 'd': 'sfecx', 'e': 'wrsdf',
+        'f': 'dgrtcv', 'g': 'fhtybn', 'h': 'gjyunb', 'i': 'uojkl', 'j': 'hkunmi',
+        'k': 'jlomi', 'l': 'kop', 'm': 'njk', 'n': 'bhjm', 'o': 'ipkl',
+        'p': 'ol', 'q': 'wa', 'r': 'edft', 's': 'awedxz', 't': 'rfgy',
+        'u': 'yihj', 'v': 'cfgb', 'w': 'qase', 'x': 'zsdc', 'y': 'tghu',
+        'z': 'xas',
+    };
+    const TYPO_CHANCE = 0.07;
+
+    function getNearbyChar(ch) {
+        const lower = ch.toLowerCase();
+        if (NEARBY_KEYS[lower]) {
+            const options = NEARBY_KEYS[lower];
+            const replacement = options.charAt(Math.floor(Math.random() * options.length));
+            return ch === ch.toUpperCase() ? replacement.toUpperCase() : replacement;
+        }
+        const abc = "abcdefghijklmnopqrstuvwxyz";
+        return abc.charAt(Math.floor(Math.random() * abc.length));
+    }
+
+    const sleep = ms => new Promise(r => setTimeout(r, ms));
+
+    async function typeMessageWithTypos(element, text) {
+        let displayed = "";
+        const words = text.split(" ");
+        
+        for (let i = 0; i < words.length; i++) {
+            const word = words[i];
+            const separator = i > 0 ? " " : "";
+            const isAlpha = /^[a-zA-Z]+$/.test(word);
+            
+            // Randomly insert a typo
+            if (i > 0 && word.length > 4 && Math.random() < TYPO_CHANCE && isAlpha) {
+                const typoPos = Math.floor(Math.random() * (word.length - 2)) + 2;
+                
+                // 1. Type correct part
+                for (let char of (separator + word.substring(0, typoPos))) {
+                    displayed += char;
+                    element.textContent = displayed;
+                    await sleep(Math.random() * 40 + 30);
+                }
+                // 2. Type wrong char
+                const wrongChar = getNearbyChar(word[typoPos]);
+                displayed += wrongChar;
+                element.textContent = displayed;
+                await sleep(Math.random() * 150 + 150); // Realize error
+                
+                // 3. Backspace
+                await sleep(Math.random() * 200 + 200);
+                displayed = displayed.slice(0, -1);
+                element.textContent = displayed;
+                await sleep(Math.random() * 100 + 100);
+                
+                // 4. Type rest
+                for (let char of word.substring(typoPos)) {
+                    displayed += char;
+                    element.textContent = displayed;
+                    await sleep(Math.random() * 40 + 40);
+                }
+            } else {
+                // Type normally
+                for (let char of (separator + word)) {
+                    displayed += char;
+                    element.textContent = displayed;
+                    await sleep(char === " " ? Math.random() * 70 + 80 : Math.random() * 40 + 20);
+                }
+            }
+            
+            messagesContainer.scrollTop = messagesContainer.scrollHeight;
+            
+            // Punctuation pauses
+            if (word && [".", "!", "?"].includes(word[word.length - 1])) {
+                await sleep(Math.random() * 400 + 400);
+            } else if (word && [",", ":", ";"].includes(word[word.length - 1])) {
+                await sleep(Math.random() * 200 + 200);
+            }
+        }
+    }
+
+    async function handleSend() {
+        const text = inputField.value.trim();
+        if (!text) return;
+
+        // UI state lock
+        inputField.value = '';
+        inputField.disabled = true;
+        sendButton.disabled = true;
+
+        appendMessage('user', text);
+        const typingEl = showTypingIndicator();
+
+        try {
+            // Call the FastAPI Backend directly
+            const response = await fetch(API_URL, {
+                method: 'POST',
+                headers: { 'Content-Type': 'application/json' },
+                body: JSON.stringify({ 
+                    message: text, 
+                    history: chatHistory,
+                    session_id: sessionId
+                })
+            });
+
+            if (!response.ok) {
+                if (response.status === 429) throw new Error("Rate limit exceeded.");
+                throw new Error("Server error.");
+            }
+
+            const data = await response.json();
+            const reply = data.reply;
+
+            typingEl.remove();
+            const botEl = appendMessage('bot', '');
+
+            // Update local memory
+            chatHistory.push({ role: "user", content: text });
+            chatHistory.push({ role: "assistant", content: reply });
+
+            // Stream text out
+            await typeMessageWithTypos(botEl, reply);
+
+        } catch (error) {
+            console.error(error);
+            typingEl.remove();
+            appendMessage('bot', "⚠️ I'm sorry, I encountered an error. Please try again.");
+        } finally {
+            inputField.disabled = false;
+            sendButton.disabled = false;
+            inputField.focus();
+        }
+    }
+
+    // Event Listeners
+    sendButton.addEventListener('click', handleSend);
+    inputField.addEventListener('keypress', function(e) {
+        if (e.key === 'Enter') handleSend();
+    });
+
+})();
+</script>
+
+</body>
+</html>

backup_2026-05-04/wordpress code/addon_backup.html

@@ -0,0 +1,175 @@
+<style>
+    /* Premium Design for Martechsol Assistant */
+    @import url('https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600&display=swap');
+
+    #martech-chat-wrapper {
+        font-family: 'Inter', -apple-system, BlinkMacSystemFont, sans-serif;
+    }
+
+    /* Floating Action Button (FAB) */
+    #martech-chat-fab {
+        position: fixed;
+        right: 10px;
+        bottom: 25px;
+        width: auto;
+        height: auto;
+        background: transparent;
+        border-radius: 50%;
+        display: flex;
+        align-items: center;
+        justify-content: center;
+        cursor: pointer;
+        z-index: 999999;
+        transition: transform 0.4s cubic-bezier(0.34, 1.56, 0.64, 1), background 0.3s ease, box-shadow 0.3s ease;
+        -webkit-tap-highlight-color: transparent;
+    }
+
+    #martech-chat-fab:hover {
+        transform: scale(1.1);
+    }
+
+    #martech-chat-fab.is-active {
+        background: #1e293b;
+        box-shadow: 0 10px 25px rgba(30, 41, 59, 0.4);
+        transform: scale(0.8);
+    }
+
+    /* Chat Window Styling */
+    #martech-chat-box {
+        position: fixed;
+        right: 25px;
+        bottom: 100px;
+        width: 400px;
+        height: 550px;
+        background: #ffffff;
+        border-radius: 16px;
+        overflow: hidden;
+        display: none;
+        flex-direction: column;
+        box-shadow: 0 12px 50px rgba(0, 0, 0, 0.2);
+        z-index: 999998;
+        border: 1px solid #e2e8f0;
+        opacity: 0;
+        transform: translateY(20px);
+        transition: opacity 0.3s ease, transform 0.3s cubic-bezier(0.34, 1.56, 0.64, 1);
+    }
+
+    #martech-chat-box.is-visible {
+        display: flex;
+        opacity: 1;
+        transform: translateY(0);
+    }
+
+    #martech-chat-header {
+        background: #ffffff;
+        padding: 16px 20px;
+        border-bottom: 1px solid #f1f5f9;
+        display: flex;
+        align-items: center;
+        gap: 12px;
+    }
+
+    @keyframes pulse-dot {
+        0% {
+            transform: scale(1);
+            box-shadow: 0 0 0 0 rgba(16, 185, 129, 0.7);
+        }
+
+        70% {
+            transform: scale(1.1);
+            box-shadow: 0 0 0 10px rgba(16, 185, 129, 0);
+        }
+
+        100% {
+            transform: scale(1);
+            box-shadow: 0 0 0 0 rgba(16, 185, 129, 0);
+        }
+    }
+
+    #martech-chat-header .dot {
+        width: 10px;
+        height: 10px;
+        background: #10b981;
+        border-radius: 50%;
+        animation: pulse-dot 2s infinite;
+    }
+
+    #martech-chat-header span {
+        font-weight: 600;
+        color: #1e293b;
+        font-size: 15px;
+    }
+
+    #martech-chat-box iframe {
+        width: 100%;
+        flex: 1;
+        border: 0;
+    }
+
+    @media (max-width: 480px) {
+        #martech-chat-box {
+            right: 15px;
+            bottom: 100px;
+            width: calc(100vw - 30px);
+            height: 70vh;
+        }
+    }
+</style>
+
+<!-- Lottie Player Script -->
+<script src="https://unpkg.com/@dotlottie/player-component@latest/dist/dotlottie-player.mjs" type="module"></script>
+
+<div id="martech-chat-wrapper">
+    <div id="martech-chat-fab">
+        <!-- Animated Chatbot Icon -->
+        <div id="chat-icon"
+            style="width: 233px; height: 238px; display: flex; align-items: center; justify-content: center; pointer-events: none;">
+            <dotlottie-player
+                src="https://seashell-cattle-543014.hostingersite.com/wp-content/uploads/2026/04/KhloeSAC.lottie"
+                background="transparent" speed="1" style="width: 100%; height: 100%; will-change: transform;" loop
+                autoplay>
+            </dotlottie-player>
+        </div>
+        <!-- Close Icon -->
+        <svg id="close-icon" viewBox="0 0 24 24" style="display:none; width: 60px; height: 60px;">
+            <path
+                d="M19 6.41L17.59 5 12 10.59 6.41 5 5 6.41 10.59 12 5 17.59 6.41 19 12 13.41 17.59 19 19 17.59 13.41 12z"
+                fill="white" />
+        </svg>
+    </div>
+
+    <div id="martech-chat-box">
+        <div id="martech-chat-header">
+            <div class="dot"></div>
+            <span>Martechsol Assistant</span>
+        </div>
+        <iframe src="https://joedown11-chatrag.hf.space" allow="clipboard-write; microphone" loading="lazy"
+            referrerpolicy="no-referrer-when-downgrade"></iframe>
+    </div>
+</div>
+
+<script>
+    (function () {
+        const fab = document.getElementById('martech-chat-fab');
+        const box = document.getElementById('martech-chat-box');
+        const chatIcon = document.getElementById('chat-icon');
+        const closeIcon = document.getElementById('close-icon');
+
+        fab.addEventListener('click', function () {
+            const isVisible = box.classList.contains('is-visible');
+            if (isVisible) {
+                box.classList.remove('is-visible');
+                setTimeout(() => { box.style.display = 'none'; }, 300);
+                chatIcon.style.display = 'block';
+                closeIcon.style.display = 'none';
+                fab.classList.remove('is-active');
+            } else {
+                box.style.display = 'flex';
+                setTimeout(() => { box.classList.add('is-visible'); }, 10);
+                chatIcon.style.display = 'none';
+                closeIcon.style.display = 'block';
+                fab.classList.add('is-active');
+            }
+        });
+    })();
+</script>

backup_2026-05-13_pre_intelligent_retrieval/.env.example

@@ -0,0 +1,19 @@
+LLM_PROVIDER=fireworks
+FIREWORKS_API_KEY=your_fireworks_api_key
+FIREWORKS_MODEL=accounts/fireworks/models/qwen3-32b
+FIREWORKS_REWRITE_MODEL=accounts/fireworks/models/llama-v3p1-8b-instruct
+GROQ_API_KEY=your_groq_api_key
+GROQ_MODEL=qwen/qwen3-32b
+GROQ_REWRITE_MODEL=llama-3.1-8b-instant
+HF_API_KEY=your_huggingface_api_key
+HF_MODEL=meta-llama/Llama-3.1-8B-Instruct
+EMBEDDING_MODEL=BAAI/bge-small-en-v1.5
+DOCS_DIR=docs
+INDEX_DIR=data/index
+SESSIONS_DIR=data/sessions
+TOP_K=4
+CORS_ALLOW_ORIGINS=*
+API_KEY=
+RATE_LIMIT_REQUESTS=60
+RATE_LIMIT_WINDOW_SECONDS=60
+RAG_API_URL=

backup_2026-05-13_pre_intelligent_retrieval/.gitattributes

@@ -0,0 +1,2 @@
+*.lottie filter=lfs diff=lfs merge=lfs -text
+*.pdf filter=lfs diff=lfs merge=lfs -text

backup_2026-05-13_pre_intelligent_retrieval/.gitignore

@@ -0,0 +1,9 @@
+.env
+__pycache__/
+.pytest_cache/
+.mypy_cache/
+.venv/
+venv/
+# Ignoring data directory to prevent pushing binary index files
+data/index/
+data/sessions/

backup_2026-05-13_pre_intelligent_retrieval/CONFIG_NOTES.md

@@ -0,0 +1,38 @@
+# Configuration Backup - Martechsol RAG Chatbot
+**Date:** 2026-04-28
+**Source:** C:\Users\DELL\Desktop\RAG_backup2
+**Destination:** D:\RAG_Backup_2026_04_28
+
+## Core Settings (from app/core/config.py)
+- **App Name:** Fast RAG Chatbot
+- **LLM Provider:** groq (default)
+- **Groq Model:** llama-3.1-8b-instant
+- **HF Model:** meta-llama/Llama-3.1-8B-Instruct
+- **Embedding Model:** BAAI/bge-small-en-v1.5
+- **Docs Directory:** docs/
+- **Index Directory:** data/index/
+- **Sessions Directory:** data/sessions/
+- **Chunk Size:** 420 tokens
+- **Overlap:** 80 tokens
+- **Top K:** 4
+
+## Admin Credentials
+- **Username:** martech_admin
+- **Password:** martech_admin_303
+- **OTP Expiry:** 300 seconds (5 minutes)
+
+## Security
+- **Auth Method:** HTTP Basic Auth + OTP (email-based)
+- **Email for OTP:** randomjoedown@gmail.com
+- **SMTP Server:** smtp.gmail.com (Port 465)
+
+## API / Integration
+- **Endpoint:** /api/chat
+- **Widget Endpoint:** /widget
+- **Admin Endpoint:** /admin
+- **CORS:** Allowed for all (*) for testing
+
+## Infrastructure
+- **Hugging Face Path:** /data (for persistent storage)
+- **Local Path:** data/ (for local storage)
+- **Dockerfile:** Based on python:3.10-slim, serves on port 7860