Upload 36 files

.env

@@ -0,0 +1 @@
+qdrant = eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhY2Nlc3MiOiJtIn0.aeAEaw9iTJicWYtPqv3EzwzwhqzQGlyqFpbU02RhxKg

app/data/cleaned_file.csv

@@ -0,0 +1,149 @@
+question,answer,label
+I feel sad because I miss my dead father,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+I miss my mother ,"And your Lord has decreed that you not worship except Him, and to parents, good treatment. Whether one or both of them reach old age [while] with you, say not to them [so much as], 'uff,' and do not repel them but speak to them a noble word",1
+I feel bad for gaza people ,"And be patient, [O Muhammad], for the decision of your Lord, for indeed, you are in Our eyes. And exalt [Allah] with praise of your Lord when you arise",1
+I feel bad for martyrs in gaza and palastine,"And never think of those who have been killed in the cause of Allah as dead. Rather, they are alive with their Lord, receiving provision",1
+I am depressed and feel sad,"Kaf, Ha, Ya, Ayn, Saad.",-1
+"I lost my son, I feel so sad and powerless.","And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+What does quran or allah says about patience?,"Give good news to those who patiently endure who say, when struck by a disaster,  Surely to Allah we belong and to Him we will ?all? return. ",1
+my cat just died,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+"I feel like my world is collapsing, I am broke and I don t know what to do, in pain and lost",And persevere for ?the sake of? your Lord.,1
+What to do when I make good for people and they return with bad,Do not do a favour expecting more ?in return?.,1
+I feel so bad for what I watched in the news today,"Surely this Quran guides to what is most upright, and gives good news to the believers who do good that they will have a mighty reward.",-1
+I feel hopeless about palestine,"If you act rightly, it is for your own good, but if you do wrong, it is to your own loss.  And when the second warning would come to pass, your enemies would ?be left to? totally disgrace you and enter that place of worship as they entered it the first time, and utterly destroy whatever would fall into their hands.",1
+"I have commited a lot of sins, and I lost hope and I wanna return to Allah","Say, ?O Prophet, that Allah says,?  O My servants who have exceeded the limits against their souls! Do not lose hope in Allah s mercy, for Allah certainly forgives all sins.1 He is indeed the All-Forgiving, Most Merciful.",1
+"I have done a lot of bad things, I wanna return to allahm but I fear allah will not forgive me","Say, ?O Prophet, that Allah says,?  O My servants who have exceeded the limits against their souls! Do not lose hope in Allah s mercy, for Allah certainly forgives all sins.1 He is indeed the All-Forgiving, Most Merciful.",1
+"I was addicted to alcohol, will god forgive me?","Say, ?O Prophet, that Allah says,?  O My servants who have exceeded the limits against their souls! Do not lose hope in Allah s mercy, for Allah certainly forgives all sins.1 He is indeed the All-Forgiving, Most Merciful.",1
+I seek forgivenes,"Say, ?O Prophet, that Allah says,?  O My servants who have exceeded the limits against their souls! Do not lose hope in Allah s mercy, for Allah certainly forgives all sins.1 He is indeed the All-Forgiving, Most Merciful.",1
+I fear allah will not forgive my sins,"Say, ?O Prophet, that Allah says,?  O My servants who have exceeded the limits against their souls! Do not lose hope in Allah s mercy, for Allah certainly forgives all sins.1 He is indeed the All-Forgiving, Most Merciful.",1
+I ask for guidance,"Or ?a soul will? say,  If only Allah had guided me, I would have certainly been one of the righteous. ",-1
+"I feel like my heart is in pain, I am hopeless and depressed. I left my house and family and I lost everythin.","O  my sons! Go and search ?diligently? for Joseph and his brother. And do not lose hope in the mercy of Allah, for no one loses hope in Allah s mercy except those with no faith. ",1
+"I am fighting in Jihad against kufar, can you give me some advice","O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+"I am in the battlefield against Kufar, and I need support, I start loosing my patience","O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+"I am in the frontlines, fighting and guarding in gaza, I want some ayats about patience in Jihad and battlefield","O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+"I am in the battlefield, fighting and guardin gainst occupation","O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+"I am in the battlefield against Kufar, and I need support, I start loosing my patience","O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+give me something about jihad,"O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+tell me about fighting kufar,"O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+I can't take it anymore,"Allah does not require of any soul more than what it can afford. All good will be for its own benefit, and all evil will be to its own loss. ?The believers pray,?  Our Lord! Do not punish us if we forget or make a mistake. Our Lord! Do not place a burden on us like the one you placed on those before us. Our Lord! Do not burden us with what we cannot bear. Pardon us, forgive us, and have mercy on us. You are our ?only? Guardian. So grant us victory over the disbelieving people. ",1
+I do not think I can do it anymore,"Allah does not require of any soul more than what it can afford. All good will be for its own benefit, and all evil will be to its own loss. ?The believers pray,?  Our Lord! Do not punish us if we forget or make a mistake. Our Lord! Do not place a burden on us like the one you placed on those before us. Our Lord! Do not burden us with what we cannot bear. Pardon us, forgive us, and have mercy on us. You are our ?only? Guardian. So grant us victory over the disbelieving people. ",1
+I feel like I reach my limits,"Allah does not require of any soul more than what it can afford. All good will be for its own benefit, and all evil will be to its own loss. ?The believers pray,?  Our Lord! Do not punish us if we forget or make a mistake. Our Lord! Do not place a burden on us like the one you placed on those before us. Our Lord! Do not burden us with what we cannot bear. Pardon us, forgive us, and have mercy on us. You are our ?only? Guardian. So grant us victory over the disbelieving people. ",1
+how to treat my parents,"We have commanded people to honour their parents. But if they urge you to associate with Me what you have no knowledge of,1 then do not obey them. To Me you will ?all? return, and then I will inform you of what you used to do.",1
+I want to fight against the occupation and kufar,"O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+tell me about paradise,"We have commanded people to honour their parents. But if they urge you to associate with Me what you have no knowledge of,1 then do not obey them. To Me you will ?all? return, and then I will inform you of what you used to do.",-1
+"I feel like I have heavy moutain on me, I cant take it anymore.","Allah does not require of any soul more than what it can afford. All good will be for its own benefit, and all evil will be to its own loss. ?The believers pray,?  Our Lord! Do not punish us if we forget or make a mistake. Our Lord! Do not place a burden on us like the one you placed on those before us. Our Lord! Do not burden us with what we cannot bear. Pardon us, forgive us, and have mercy on us. You are our ?only? Guardian. So grant us victory over the disbelieving people. ",1
+What should we do against the occupation,"O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+what if I dislike something,And live with them in kindness. For if you dislike them - perhaps you dislike a thing and Allah makes therein much good,-1
+I have problems with my wife,"When you divorce women and they have reached the end of their waiting period, do not ?let the guardians? prevent them from re-marrying their ex-husbands if they come to an honourable agreement. This is enjoined on whoever has faith in Allah and the Last Day. This is purer and more dignifying for you. Allah knows and you do not know.",-1
+I have problems with my divorced wife,"And if you divorce them before consummating the marriage but after deciding on a dowry, pay half of the dowry, unless the wife graciously waives it or the husband graciously pays in full. Graciousness is closer to righteousness. And do not forget kindness among yourselves. Surely Allah is All-Seeing of what you do.",1
+I wanna be a martyr,"O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+"I can't take it anymore, I don t know what to do","Allah does not require of any soul more than what it can afford. All good will be for its own benefit, and all evil will be to its own loss. ?The believers pray,?  Our Lord! Do not punish us if we forget or make a mistake. Our Lord! Do not place a burden on us like the one you placed on those before us. Our Lord! Do not burden us with what we cannot bear. Pardon us, forgive us, and have mercy on us. You are our ?only? Guardian. So grant us victory over the disbelieving people. ",1
+What to do when I devorcem tell me,"When you divorce women and they have ?almost? reached the end of their waiting period, either retain them honourably or let them go honourably. But do not retain them ?only? to harm them ?or? to take advantage ?of them?. Whoever does that surely wrongs his own soul. Do not take Allah s revelations lightly. Remember Allah s favours upon you as well as the Book and wisdom1 He has sent down for your guidance. Be mindful of Allah, and know that Allah has ?perfect? knowledge of all things.",1
+tell me about divorce,"When you divorce women and they have ?almost? reached the end of their waiting period, either retain them honourably or let them go honourably. But do not retain them ?only? to harm them ?or? to take advantage ?of them?. Whoever does that surely wrongs his own soul. Do not take Allah s revelations lightly. Remember Allah s favours upon you as well as the Book and wisdom1 He has sent down for your guidance. Be mindful of Allah, and know that Allah has ?perfect? knowledge of all things.",1
+What to do when I divorce,"When you divorce women and they have ?almost? reached the end of their waiting period, either retain them honourably or let them go honourably. But do not retain them ?only? to harm them ?or? to take advantage ?of them?. Whoever does that surely wrongs his own soul. Do not take Allah s revelations lightly. Remember Allah s favours upon you as well as the Book and wisdom1 He has sent down for your guidance. Be mindful of Allah, and know that Allah has ?perfect? knowledge of all things.",1
+I am sad seeing what Israel is doing for chindren in gaza and palastine,O Children of Israel! Remember ?all? the favours I granted you and how I honoured you above the others,-1
+"I am really sad, I hate my life and I wanna suicide","And seek help through patience and prayer. Indeed, it is a burden except for the humble",1
+"I did a lot of sins, what to do know?","?They are? those who, upon committing an evil deed or wronging themselves, remember Allah and seek forgiveness for their sins and who forgives sins except Allah? and they do not knowingly persist in wrongdoing?",1
+"I feel like demons and devil are defeating me, I am losing my belief","?They say,?  Our Lord! Do not let our hearts deviate after you have guided us. Grant us Your mercy. You are indeed the Giver ?of all bounties?.",1
+tell me about patience,"O you who have believed, seek help through patience and prayer. Indeed, Allah is with the patient",1
+what is peace in islam?,"And if an evil whisper comes to you from Satan, then seek refuge in Allah. Indeed, He is Hearing and Knowing",-1
+"I am in pain, I feel useless","O you who have believed, seek help through patience and prayer. Indeed, Allah is with the patient",1
+What is patience ?,"O you who have believed, seek help through patience and prayer. Indeed, Allah is with the patient",1
+"sometimes I get a lot of evil thoughts, and I fear for no reasons, maybe devil is hurting me?","And if an evil whisper comes to you from Satan, then seek refuge in Allah. Indeed, He is Hearing and Knowing",1
+I am fighting against the enemy,"O mankind, eat from whatever is on earth [that is] lawful and good and do not follow the footsteps of Satan. Indeed, he is to you a clear enemy",-1
+"I dislike my life, I hate my life, I hate my wife, I hate my family, I don t deserve this",And live with them in kindness. For if you dislike them - perhaps you dislike a thing and Allah makes therein much good,1
+"I don t like the field I am studying,I wish I am studying what I like, I am depressed now, what to do?",And live with them in kindness. For if you dislike them - perhaps you dislike a thing and Allah makes therein much good,1
+"I wanted to marry a girl, but I couldn't and now she is married","But perhaps you hate a thing and it is good for you; and perhaps you love a thing and it is bad for you. And Allah knows, while you know not",1
+I failed in exams,"But perhaps you hate a thing and it is good for you; and perhaps you love a thing and it is bad for you. And Allah knows, while you know not",1
+I can not provide for my family,"Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",-1
+"I live in a very bad country, I wish I live in another country","But perhaps you hate a thing and it is good for you; and perhaps you love a thing and it is bad for you. And Allah knows, while you know not",1
+"Thank you very much, you made my day better, thanks","Those who believe and do good, for them will be bliss and an honourable destination. ",1
+"I want to return to allah, I made a lot of bad things, how to return to alla?",There is no god ?worthy of worship? except You. Glory be to You! I have certainly done wrong.,1
+"God bless you, and grant you paradise","Those who believe and do good, for them will be bliss and an honourable destination. ",1
+I feel like allah is testing me,"But perhaps you hate a thing and it is good for you; and perhaps you love a thing and it is bad for you. And Allah knows, while you know not",1
+can quran cure me,"O humanity! Indeed, there has come to you a warning from your Lord, a cure for what is in the hearts, a guide, and a mercy for the believers.",1
+"I did a lot of good deeds, what should I get?","Those who believe and do good, for them will be bliss and an honourable destination. ",1
+"I was a bad person, now I wanna return to allah",There is no god ?worthy of worship? except You. Glory be to You! I have certainly done wrong.,1
+what is mercy in quran,"O humanity! Indeed, there has come to you a warning from your Lord, a cure for what is in the hearts, a guide, and a mercy for the believers.",1
+how can quran cure me and make me happy?,"O humanity! Indeed, there has come to you a warning from your Lord, a cure for what is in the hearts, a guide, and a mercy for the believers.",1
+"I feel so ill, headache and pain in my teeths, I am sick, how can you help me?","And when I am ill, it is He who cures me",1
+"My mother just died, I feel so sad","Every soul will taste death. And you will only receive your full reward on the Day of Judgment. Whoever is spared from the Fire and is admitted into Paradise will ?indeed? triumph, whereas the life of this world is no more than the delusion of enjoyment.",1
+"is prayers mandatory, I want my brother and may family to pray everyday","Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1
+what is quran,"O humanity! Indeed, there has come to you a warning from your Lord, a cure for what is in the hearts, a guide, and a mercy for the believers.",1
+do I need to do good deeds,"And say, 'Do [as you will], for Allah will see your deeds, and [so will] His Messenger and the believers",1
+non believers are disturbing me and bothering me,"Be patient ?O Prophet?, for your patience is only with Allah s help. Do not grieve over those ?who disbelieve?, nor be distressed by their schemes.",1
+"I lost my friend, he died and I miss him","Every soul will taste death. And you will only receive your full reward on the Day of Judgment. Whoever is spared from the Fire and is admitted into Paradise will ?indeed? triumph, whereas the life of this world is no more than the delusion of enjoyment.",1
+I am so sick,"And when I am ill, it is He who cures me",1
+I fear death,"Every soul will taste death. And you will only receive your full reward on the Day of Judgment. Whoever is spared from the Fire and is admitted into Paradise will ?indeed? triumph, whereas the life of this world is no more than the delusion of enjoyment.",1
+I am so sick and afraid that I will not survive,"And when I am ill, it is He who cures me",1
+I have cancer and I am hopeless,"Be patient ?O Prophet?, for your patience is only with Allah s help. Do not grieve over those ?who disbelieve?, nor be distressed by their schemes.",1
+What about working for good deeds,"And say, 'Do [as you will], for Allah will see your deeds, and [so will] His Messenger and the believers",1
+"I am scared and afraid of death, since my friend died","Every soul will taste death. And you will only receive your full reward on the Day of Judgment. Whoever is spared from the Fire and is admitted into Paradise will ?indeed? triumph, whereas the life of this world is no more than the delusion of enjoyment.",1
+How to be patient,"Be patient ?O Prophet?, for your patience is only with Allah s help. Do not grieve over those ?who disbelieve?, nor be distressed by their schemes.",1
+tell me about death,"Every soul will taste death. And you will only receive your full reward on the Day of Judgment. Whoever is spared from the Fire and is admitted into Paradise will ?indeed? triumph, whereas the life of this world is no more than the delusion of enjoyment.",1
+am I gonna be judged for my good things and deeds?,"And say, 'Do [as you will], for Allah will see your deeds, and [so will] His Messenger and the believers",1
+"I want my friend to pray, tell me about prayers?","Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1
+"I dream of a lot of things I wanna realise, can allah realise them for me","And your Lord says, 'Call upon Me; I will respond to you.",1
+tell me about good deeds,And establish prayer and give zakah and bow with those who bow [in worship and obedience],1
+does allah answer my prayers?,"When My servants ask you ?O Prophet? about Me: I am truly near. I respond to one s prayer when they call upon Me. So let them respond ?with obedience? to Me and believe in Me, perhaps they will be guided ?to the Right Way?.",1
+are prayers or salat obligatory,"Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1
+I always pray but I do not get what I ask for,"And your Lord says, 'Call upon Me; I will respond to you.",1
+tell me about prayers,And establish prayer and give zakah and bow with those who bow [in worship and obedience],1
+I am very poor and I cant provide for my family,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+my dog died and I am sad and depressed,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+I am depressed and feel scared,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+will god respond to my prayers?,"And your Lord says, 'Call upon Me; I will respond to you.",1
+will allah answer my prayers?,"When My servants ask you ?O Prophet? about Me: I am truly near. I respond to one s prayer when they call upon Me. So let them respond ?with obedience? to Me and believe in Me, perhaps they will be guided ?to the Right Way?.",1
+tell me about praying,And establish prayer and give zakah and bow with those who bow [in worship and obedience],1
+"is allah testing me or turtoring me, it is really difficult","And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+tell me about food in quran,"O mankind, eat from whatever is on earth [that is] lawful and good and do not follow the footsteps of Satan. Indeed, he is to you a clear enemy",1
+how to behave in family arguments ,"Repel evil with that which is better, and then the one whom there is enmity between you and him will become as though he was a close friend",1
+I feel hungry,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+I feel really hungry and I need food,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+what about food in quran,"O mankind, eat from whatever is on earth [that is] lawful and good and do not follow the footsteps of Satan. Indeed, he is to you a clear enemy",1
+my familly do no let me pray,"Again, no! Never obey him ?O Prophet?! Rather, ?continue to? prostrate and draw near ?to Allah?.",1
+my familly do not treat me good,"Repel evil with that which is better, and then the one whom there is enmity between you and him will become as though he was a close friend",1
+how to act in arguments,"And when the ignorant address them, they say words of peace",1
+"tell me about mercy, I want to have mercy in my life",We have sent you ?O Prophet? only as a mercy for the whole world.,1
+"how to avoid fights, and spread love?","Repel evil with that which is better, and then the one whom there is enmity between you and him will become as though he was a close friend",1
+my name is Mohammed,We have sent you ?O Prophet? only as a mercy for the whole world.,-1
+"tell me about Mohammed, prophet mohammed",We have sent you ?O Prophet? only as a mercy for the whole world.,1
+my friends are not letting me pray,"Again, no! Never obey him ?O Prophet?! Rather, ?continue to? prostrate and draw near ?to Allah?.",1
+how to act against the evil ,Not equal are the good deed and the bad deed. Repel [evil] by that [deed] which is better; and thereupon the one whom between you and him is enmity [will become] as though he was a devoted friend,1
+how to act against the evil?,"Repel evil with that which is better, and then the one whom there is enmity between you and him will become as though he was a close friend",1
+what to do when an ignorant start to argue with me?,"And when the ignorant address them, they say words of peace",1
+sometimes I feel like the devil will not let me pray,"Again, no! Never obey him ?O Prophet?! Rather, ?continue to? prostrate and draw near ?to Allah?.",1
+what is the message of Islam,We have sent you ?O Prophet? only as a mercy for the whole world.,1
+what to do when an argument srarts at home with the familly,"And when the ignorant address them, they say words of peace",-1
+what if they do not let me pray,"Again, no! Never obey him ?O Prophet?! Rather, ?continue to? prostrate and draw near ?to Allah?.",1
+my friend turned on me and now he is asking for help,Not equal are the good deed and the bad deed. Repel [evil] by that [deed] which is better; and thereupon the one whom between you and him is enmity [will become] as though he was a devoted friend,1
+I argue a lot,"And when the ignorant address them, they say words of peace",1
+someone is against praying,"Again, no! Never obey him ?O Prophet?! Rather, ?continue to? prostrate and draw near ?to Allah?.",1
+my teacher is treating me so bad,Not equal are the good deed and the bad deed. Repel [evil] by that [deed] which is better; and thereupon the one whom between you and him is enmity [will become] as though he was a devoted friend,1
+tell me about peace,"And when the ignorant address them, they say words of peace",-1
+how to be a friend with the enemy,"Repel evil with that which is better, and then the one whom there is enmity between you and him will become as though he was a close friend",1
+what is the message of prophet Mohammed,We have sent you ?O Prophet? only as a mercy for the whole world.,1
+"tell me about mercy, I want to have mercy in my life",We have sent you ?O Prophet? only as a mercy for the whole world.,1
+I am sad I saw kids in gaza are dying,And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+I want peace,We have sent you ?O Prophet? only as a mercy for the whole world.,1
+"I saw someone killing a cat in the street, I felt helpless and sad",And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+"my boss is really opressive, what does quran says about opression?",And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+What to do when I make good for people and they return with bad,Do not do a favour expecting more ?in return?.,1
+what about opression?,And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+"is prayers mandatory, I want my brother and may family to pray everyday","Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1
+What to do when I make good for people and they return with bad,Do not do a favour expecting more ?in return?.,1
+people opressed me,And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+"I saw people very hungry in gaza because of ocupation, I feel sad for them",And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+"is prayers mandatory, I want my brother and may family to pray everyday","Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1
+What to do when I make good for people and they return with bad,Do not do a favour expecting more ?in return?.,1
+"Israel, America and Kufar are opressing muslims, ocupying them, killing them",And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+I feel sad for palastine ,And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+my cousin got prisoned by opression,And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+What to do when I make good for people and they return with bad,Do not do a favour expecting more ?in return?.,1
+what allah will do for opressives,And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+what will happen for opressives in the day of judgment,And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+I hate occupatoin and opression,And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror],1
+"is prayers mandatory, I want my brother and may family to pray everyday","Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1
+"is prayers mandatory, I want my brother and may family to pray everyday","Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1
+"is prayers mandatory, I want my brother and may family to pray everyday","Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1
+"is prayers mandatory, I want my brother and may family to pray everyday","Bid your people to pray, and be diligent in ?observing? it. We do not ask you to provide. It is We Who provide for you. And the ultimate outcome is ?only? for ?the people of? righteousness.",1

app/data/myislamicqsdataset.csv

@@ -0,0 +1 @@
+question,answer,label

app/data/test.csv

@@ -0,0 +1,21 @@
+question,answer,label
+I feel so depressed and lonely after losing my job,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+My father passed away last month and I can't stop crying,"Every soul will taste death. And you will only receive your full reward on the Day of Judgment. Whoever is spared from the Fire and is admitted into Paradise will ?indeed? triumph, whereas the life of this world is no more than the delusion of enjoyment.",1
+I committed many sins in my youth and now I regret them,"Say, ?O Prophet, that Allah says,?  O My servants who have exceeded the limits against their souls! Do not lose hope in Allah s mercy, for Allah certainly forgives all sins.1 He is indeed the All-Forgiving, Most Merciful.",1
+How can I be more patient with my difficult situation?,"O you who have believed, seek help through patience and prayer. Indeed, Allah is with the patient",1
+I'm struggling financially and can't pay my bills,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+My wife and I are constantly arguing,"And live with them in kindness. For if you dislike them - perhaps you dislike a thing and Allah makes therein much good",1
+I feel distant from Allah and don't know how to reconnect,"When My servants ask you ?O Prophet? about Me: I am truly near. I respond to one s prayer when they call upon Me. So let them respond ?with obedience? to Me and believe in Me, perhaps they will be guided ?to the Right Way?.",1
+What should I do when I have evil thoughts?,"And if an evil whisper comes to you from Satan, then seek refuge in Allah. Indeed, He is Hearing and Knowing",1
+I'm sick with fever and feel very weak,"And when I am ill, it is He who cures me",1
+How can I strengthen my faith in difficult times?,"O believers! Patiently endure, persevere, stand on guard,1 and be mindful of Allah, so you may be successful.",1
+I feel hopeless about the situation in Palestine,"And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror]",1
+My children don't respect me anymore,"We have commanded people to honour their parents. But if they urge you to associate with Me what you have no knowledge of,1 then do not obey them. To Me you will ?all? return, and then I will inform you of what you used to do.",1
+I want to repent but feel my sins are too great,"?They are? those who, upon committing an evil deed or wronging themselves, remember Allah and seek forgiveness for their sins and who forgives sins except Allah? and they do not knowingly persist in wrongdoing?",1
+I'm being treated unfairly at work,"And never think that Allah is unaware of what the wrongdoers do. He only delays them for a Day when eyes will stare [in horror]",1
+How can I control my anger during arguments?,"And when the ignorant address them, they say words of peace",1
+I feel so anxious about the future,"Allah does not require of any soul more than what it can afford. All good will be for its own benefit, and all evil will be to its own loss.",1
+My prayers feel unanswered - what should I do?,"And your Lord says, 'Call upon Me; I will respond to you.",1
+I lost my home in a natural disaster,"And We will surely test you with something of fear and hunger and a loss of wealth and lives and fruits, but give good tidings to the patient",1
+How can I be a better Muslim?,"And establish prayer and give zakah and bow with those who bow [in worship and obedience]",1
+I'm struggling with addiction and want to stop,"Say, ?O Prophet, that Allah says,?  O My servants who have exceeded the limits against their souls! Do not lose hope in Allah s mercy, for Allah certainly forgives all sins.1 He is indeed the All-Forgiving, Most Merciful.",1

app/data_loader.py

@@ -0,0 +1,51 @@
+import pandas as pd
+from sentence_transformers import SentenceTransformer
+import torch
+from app.utils import remove_numbers
+from app.qdrant_client import client
+from qdrant_client.http import models
+from pympler import asizeof
+print("Loading model and data...")
+
+device = 'cuda' if torch.cuda.is_available() else 'cpu'
+print(f"Using device: {device}")
+
+model = SentenceTransformer("app/fine-tuned-sentence-transformer-my-dataset", device=device)
+print("model size : ", asizeof.asizeof(model))
+df = pd.read_csv("app/data/cleaned_file.csv")
+
+df['answer'] = df['answer'].apply(remove_numbers)
+ayat = list(set(df['answer']))
+print(f"Total unique ayat loaded: {asizeof.asizeof(ayat)}") 
+
+print("✅ Model and embeddings ready.")
+
+
+# --- Check if collection exists ---
+collections = [c.name for c in client.get_collections().collections]
+if "ayahs_collection" not in collections:
+    print("Creating Qdrant collection and uploading embeddings...")
+    embeddings = model.encode(ayat, convert_to_tensor=False).tolist()
+    client.recreate_collection(
+        collection_name="ayahs_collection",
+        
+        vectors_config=models.VectorParams(
+            size=len(embeddings[0]),
+            distance=models.Distance.COSINE
+        ),
+    )
+
+    points = [
+        models.PointStruct(
+            id=idx,
+            vector=emb,
+            payload={"text": ayah}
+        )
+        for idx, (emb, ayah) in enumerate(zip(embeddings, ayat))
+    ]
+
+    client.upsert(collection_name="ayahs_collection", points=points)
+    print("✅ Embeddings uploaded to Qdrant.")
+else:
+    print("✅ Collection already exists, skipping upload.")
+    # Load embeddings from Qdrant

app/fine-tuned-sentence-transformer-my-dataset/1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 384,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

app/fine-tuned-sentence-transformer-my-dataset/README.md

@@ -0,0 +1,358 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:148
+- loss:CosineSimilarityLoss
+base_model: sentence-transformers/all-MiniLM-L6-v2
+widget:
+- source_sentence: I live in a very bad country, I wish I live in another country
+  sentences:
+  - O believers! Patiently endure, persevere, stand on guard, and be mindful of Allah,
+    so you may be successful.
+  - But perhaps you hate a thing and it is good for you; and perhaps you love a thing
+    and it is bad for you. And Allah knows, while you know not
+  - Do not do a favour expecting more ?in return?.
+- source_sentence: My mother just died, I feel so sad
+  sentences:
+  - And never think that Allah is unaware of what the wrongdoers do. He only delays
+    them for a Day when eyes will stare [in horror]
+  - Every soul will taste death. And you will only receive your full reward on the
+    Day of Judgment. Whoever is spared from the Fire and is admitted into Paradise
+    will ?indeed? triumph, whereas the life of this world is no more than the delusion
+    of enjoyment.
+  - Every soul will taste death. And you will only receive your full reward on the
+    Day of Judgment. Whoever is spared from the Fire and is admitted into Paradise
+    will ?indeed? triumph, whereas the life of this world is no more than the delusion
+    of enjoyment.
+- source_sentence: I ask for guidance
+  sentences:
+  - We have sent you ?O Prophet? only as a mercy for the whole world.
+  - 'Or ?a soul will? say,  If only Allah had guided me, I would have certainly been
+    one of the righteous. '
+  - And live with them in kindness. For if you dislike them - perhaps you dislike
+    a thing and Allah makes therein much good
+- source_sentence: 'I feel bad for gaza people '
+  sentences:
+  - And We will surely test you with something of fear and hunger and a loss of wealth
+    and lives and fruits, but give good tidings to the patient
+  - We have sent you ?O Prophet? only as a mercy for the whole world.
+  - And be patient, [O Muhammad], for the decision of your Lord, for indeed, you are
+    in Our eyes. And exalt [Allah] with praise of your Lord when you arise
+- source_sentence: can quran cure me
+  sentences:
+  - O humanity! Indeed, there has come to you a warning from your Lord, a cure for
+    what is in the hearts, a guide, and a mercy for the believers.
+  - 'Those who believe and do good, for them will be bliss and an honourable destination. '
+  - Not equal are the good deed and the bad deed. Repel [evil] by that [deed] which
+    is better; and thereupon the one whom between you and him is enmity [will become]
+    as though he was a devoted friend
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) <!-- at revision c9745ed1d9f207416be6d2e6f8de32d1f16199bf -->
+- **Maximum Sequence Length:** 256 tokens
+- **Output Dimensionality:** 384 dimensions
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'BertModel'})
+  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("sentence_transformers_model_id")
+# Run inference
+sentences = [
+    'can quran cure me',
+    'O humanity! Indeed, there has come to you a warning from your Lord, a cure for what is in the hearts, a guide, and a mercy for the believers.',
+    'Not equal are the good deed and the bad deed. Repel [evil] by that [deed] which is better; and thereupon the one whom between you and him is enmity [will become] as though he was a devoted friend',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 384]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[1.0000, 0.9580, 0.9128],
+#         [0.9580, 1.0000, 0.9162],
+#         [0.9128, 0.9162, 1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### Unnamed Dataset
+
+* Size: 148 training samples
+* Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>
+* Approximate statistics based on the first 148 samples:
+  |         | sentence_0                                                                        | sentence_1                                                                          | label                                           |
+  |:--------|:----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:------------------------------------------------|
+  | type    | string                                                                            | string                                                                              | int                                             |
+  | details | <ul><li>min: 5 tokens</li><li>mean: 12.09 tokens</li><li>max: 30 tokens</li></ul> | <ul><li>min: 14 tokens</li><li>mean: 38.55 tokens</li><li>max: 121 tokens</li></ul> | <ul><li>-1: ~8.78%</li><li>1: ~91.22%</li></ul> |
+* Samples:
+  | sentence_0                                                                                                  | sentence_1                                                                                                                                                                                                                                | label          |
+  |:------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------|
+  | <code>I have done a lot of bad things, I wanna return to allahm but I fear allah will not forgive me</code> | <code>Say, ?O Prophet, that Allah says,?  O My servants who have exceeded the limits against their souls! Do not lose hope in Allah s mercy, for Allah certainly forgives all sins. He is indeed the All-Forgiving, Most Merciful.</code> | <code>1</code> |
+  | <code>how to act in arguments</code>                                                                        | <code>And when the ignorant address them, they say words of peace</code>                                                                                                                                                                  | <code>1</code> |
+  | <code>I failed in exams</code>                                                                              | <code>But perhaps you hate a thing and it is good for you; and perhaps you love a thing and it is bad for you. And Allah knows, while you know not</code>                                                                                 | <code>1</code> |
+* Loss: [<code>CosineSimilarityLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosinesimilarityloss) with these parameters:
+  ```json
+  {
+      "loss_fct": "torch.nn.modules.loss.MSELoss"
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `num_train_epochs`: 20
+- `multi_dataset_batch_sampler`: round_robin
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: no
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 8
+- `per_device_eval_batch_size`: 8
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 1
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 5e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1
+- `num_train_epochs`: 20
+- `max_steps`: -1
+- `lr_scheduler_type`: linear
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.0
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `bf16`: False
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: False
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `parallelism_config`: None
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `project`: huggingface
+- `trackio_space_id`: trackio
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `hub_revision`: None
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: no
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `liger_kernel_config`: None
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: True
+- `prompts`: None
+- `batch_sampler`: batch_sampler
+- `multi_dataset_batch_sampler`: round_robin
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Framework Versions
+- Python: 3.12.7
+- Sentence Transformers: 5.1.1
+- Transformers: 4.57.1
+- PyTorch: 2.5.1
+- Accelerate: 1.11.0
+- Datasets: 4.3.0
+- Tokenizers: 0.22.1
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

app/fine-tuned-sentence-transformer-my-dataset/config.json

@@ -0,0 +1,25 @@
+{
+  "architectures": [
+    "BertModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "dtype": "float32",
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 384,
+  "initializer_range": 0.02,
+  "intermediate_size": 1536,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 6,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "transformers_version": "4.57.1",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 30522
+}

app/fine-tuned-sentence-transformer-my-dataset/config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "sentence_transformers": "5.1.1",
+    "transformers": "4.57.1",
+    "pytorch": "2.5.1"
+  },
+  "model_type": "SentenceTransformer",
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine"
+}

app/fine-tuned-sentence-transformer-my-dataset/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:126596ca11dd95f7a7a657a49dab20a47f7c0c62667db5e63d2c14c751b5ce9c
+size 90864192

app/fine-tuned-sentence-transformer-my-dataset/modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

app/fine-tuned-sentence-transformer-my-dataset/sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 256,
+    "do_lower_case": false
+}

app/fine-tuned-sentence-transformer-my-dataset/special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

app/fine-tuned-sentence-transformer-my-dataset/tokenizer_config.json

@@ -0,0 +1,65 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "[CLS]",
+  "do_basic_tokenize": true,
+  "do_lower_case": true,
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "max_length": 128,
+  "model_max_length": 256,
+  "never_split": null,
+  "pad_to_multiple_of": null,
+  "pad_token": "[PAD]",
+  "pad_token_type_id": 0,
+  "padding_side": "right",
+  "sep_token": "[SEP]",
+  "stride": 0,
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "truncation_side": "right",
+  "truncation_strategy": "longest_first",
+  "unk_token": "[UNK]"
+}

app/main.py

@@ -0,0 +1,36 @@
+from fastapi import FastAPI
+from app.rag import find_top_5_ayahs_qdrant
+from app.models.schemas import QuestionRequest, AnswerListResponse
+import psutil, os, asyncio
+
+app = FastAPI()
+
+def get_memory_usage_mb() -> float:
+    """Return current memory usage in MB."""
+    process = psutil.Process(os.getpid())
+    return process.memory_info().rss / (1024 * 1024)
+
+@app.on_event("startup")
+async def log_memory_usage():
+    """Background task that prints memory usage every 10 seconds."""
+    async def monitor():
+        while True:
+            mem = get_memory_usage_mb()
+            print(f"💾 Memory usage: {mem:.2f} MB")
+            await asyncio.sleep(10)
+    asyncio.create_task(monitor())
+
+@app.post("/ask/", response_model=AnswerListResponse)
+def ask(payload: QuestionRequest):
+    results = find_top_5_ayahs_qdrant(payload.question)
+    return {"results": results}
+
+@app.get("/")
+def read_root():
+    return {"message": "Hello, Mustafa! FastAPI is running 🚀"}
+
+@app.get("/memory")
+def memory_endpoint():
+    """Check memory usage manually via /memory"""
+    mem = get_memory_usage_mb()
+    return {"memory_MB": round(mem, 2)}

app/models/schemas.py

@@ -0,0 +1,12 @@
+from pydantic import BaseModel
+from typing import List
+
+class QuestionRequest(BaseModel):
+    question: str
+
+class AyahResponse(BaseModel):
+    question: str
+    answer: str
+
+class AnswerListResponse(BaseModel):
+    results: List[AyahResponse]

app/qdrant_client.py

@@ -0,0 +1,6 @@
+from qdrant_client import QdrantClient
+
+client = QdrantClient(
+    url="https://6ea859f1-904f-4600-a943-00d18c01b454.europe-west3-0.gcp.cloud.qdrant.io:6333",  
+    api_key="eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhY2Nlc3MiOiJtIn0.aeAEaw9iTJicWYtPqv3EzwzwhqzQGlyqFpbU02RhxKg"
+)

app/rag.py

@@ -0,0 +1,38 @@
+from app.data_loader import model
+from sklearn.metrics.pairwise import cosine_similarity
+from app.qdrant_client import client
+
+from pympler import asizeof
+"""
+def find_top_5_ayahs(question: str):
+    q_emb = model.encode(question)
+    sims = cosine_similarity([q_emb], embeddings)[0]
+    top_indices = sims.argsort()[-5:][::-1]
+
+    results = []
+    for i in top_indices:
+        ayah_text = ayat[i]  # single column with the ayah text
+        results.append({
+            "question": question,   # the question from the request
+            "answer": ayah_text     # the ayah text
+        })
+    return results
+"""
+# find top 5 ayahs from Qdrant (alternative method)
+def find_top_5_ayahs_qdrant(question: str):
+    q_emb = model.encode(question).tolist()
+    search_result = client.search(
+        collection_name="ayahs_collection",
+        query_vector=q_emb,
+        limit=5
+    )
+
+    results = []
+    for point in search_result:
+        ayah_text = point.payload['text']
+        results.append({
+            "question": question,
+            "answer": ayah_text
+        })
+    print("results size : ",asizeof.asizeof(results))
+    return results

app/utils.py

@@ -0,0 +1,3 @@
+import re
+def remove_numbers(text):
+    return re.sub(r'\d+', '', text)

requirements.in

@@ -0,0 +1,5 @@
+fastapi
+uvicorn
+scikit-learn
+pandas
+sentence-transformers

requirements.txt

@@ -0,0 +1,141 @@
+#
+# This file is autogenerated by pip-compile with Python 3.12
+# by the following command:
+#
+#    pip-compile requirements.in
+#
+annotated-doc==0.0.3
+    # via fastapi
+annotated-types==0.7.0
+    # via pydantic
+anyio==4.11.0
+    # via starlette
+certifi==2025.10.5
+    # via requests
+charset-normalizer==3.4.4
+    # via requests
+click==8.3.0
+    # via uvicorn
+colorama==0.4.6
+    # via
+    #   click
+    #   tqdm
+fastapi==0.120.2
+    # via -r requirements.in
+filelock==3.20.0
+    # via
+    #   huggingface-hub
+    #   torch
+    #   transformers
+fsspec==2025.10.0
+    # via
+    #   huggingface-hub
+    #   torch
+h11==0.16.0
+    # via uvicorn
+huggingface-hub==0.36.0
+    # via
+    #   sentence-transformers
+    #   tokenizers
+    #   transformers
+idna==3.11
+    # via
+    #   anyio
+    #   requests
+jinja2==3.1.6
+    # via torch
+joblib==1.5.2
+    # via scikit-learn
+markupsafe==3.0.3
+    # via jinja2
+mpmath==1.3.0
+    # via sympy
+networkx==3.5
+    # via torch
+numpy==2.3.4
+    # via
+    #   pandas
+    #   scikit-learn
+    #   scipy
+    #   transformers
+packaging==25.0
+    # via
+    #   huggingface-hub
+    #   transformers
+pandas==2.3.3
+    # via -r requirements.in
+pillow==12.0.0
+    # via sentence-transformers
+pydantic==2.12.3
+    # via fastapi
+pydantic-core==2.41.4
+    # via pydantic
+python-dateutil==2.9.0.post0
+    # via pandas
+pytz==2025.2
+    # via pandas
+pyyaml==6.0.3
+    # via
+    #   huggingface-hub
+    #   transformers
+regex==2025.10.23
+    # via transformers
+requests==2.32.5
+    # via
+    #   huggingface-hub
+    #   transformers
+safetensors==0.6.2
+    # via transformers
+scikit-learn==1.7.2
+    # via
+    #   -r requirements.in
+    #   sentence-transformers
+scipy==1.16.3
+    # via
+    #   scikit-learn
+    #   sentence-transformers
+sentence-transformers==5.1.2
+    # via -r requirements.in
+six==1.17.0
+    # via python-dateutil
+sniffio==1.3.1
+    # via anyio
+starlette==0.49.1
+    # via fastapi
+sympy==1.14.0
+    # via torch
+threadpoolctl==3.6.0
+    # via scikit-learn
+tokenizers==0.22.1
+    # via transformers
+torch==2.9.0
+    # via sentence-transformers
+tqdm==4.67.1
+    # via
+    #   huggingface-hub
+    #   sentence-transformers
+    #   transformers
+transformers==4.57.1
+    # via sentence-transformers
+typing-extensions==4.15.0
+    # via
+    #   anyio
+    #   fastapi
+    #   huggingface-hub
+    #   pydantic
+    #   pydantic-core
+    #   sentence-transformers
+    #   starlette
+    #   torch
+    #   typing-inspection
+typing-inspection==0.4.2
+    # via pydantic
+tzdata==2025.2
+    # via pandas
+urllib3==2.5.0
+    # via requests
+uvicorn==0.38.0
+    # via -r requirements.in
+
+# The following packages are considered to be unsafe in a requirements file:
+# setuptools

run.py

@@ -0,0 +1,5 @@
+# run.py
+import uvicorn
+
+if __name__ == "__main__":
+    uvicorn.run("app.main:app", host="0.0.0.0", port=8000, reload=True)