VedicRAG_AI

KO | EN

gitlite — search

#react #ai #llm #machine-learning #rust #deep-learning #docker #nodejs #awesome #vue #pytorch #security #ios #mcp

(★ 15)

LLM trained on Vedic shlokas using RAG

VedicRAG_AI Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# 🏛️ Digital Nalanda University: Rebuilding Ancient Wisdom Through AI

**An Open Source Initiative to Digitally Reconstruct the World's Greatest Ancient University**

---

## 📜 The Legacy of Nalanda: History's Greatest Knowledge Center

**Nalanda University** (427 CE - 1197 CE) was not merely an educational institution—it was the **world's first residential international university** and the **largest repository of scientific knowledge** in ancient history. When foreign invaders burned it down in 1197 CE, they destroyed:

- **📚 9 Million Manuscripts** spanning every known discipline of the time
- **🔬 Advanced Scientific Treatises** on mathematics, astronomy, medicine, metallurgy, and architecture
- **🧠 Philosophical Systems** that influenced civilizations across Asia
- **🌍 International Knowledge Network** with scholars from China, Korea, Japan, Tibet, and Southeast Asia

### The Scientific Brilliance of Nalanda

Nalanda's curriculum was remarkably **scientific and systematic**:

- **Mathematics**: Zero, decimal system, algebra, and calculus concepts centuries before the West
- **Astronomy**: Heliocentric theories, precise planetary calculations, and advanced observational techniques
- **Medicine**: Surgical procedures (including plastic surgery), herbal pharmacology, and holistic healing systems
- **Metallurgy**: Production of high-quality steel (Wootz steel) that was superior to any other in the world
- **Architecture**: Vastu Shastra principles creating earthquake-resistant structures
- **Linguistics**: Panini's Sanskrit grammar—a computational marvel of linguistic precision
- **Logic & Epistemology**: Rigorous systems of debate and critical thinking

**Aryabhata, Brahmagupta, Bhaskara II**—these mathematical giants emerged from this tradition. Their discoveries in trigonometry, algebra, and astronomical calculations were **centuries ahead** of their time.

---

## 🤖 Our Mission: Digital Reconstruction Through RAG AI

We are **rebuilding Nalanda University digitally** using modern Retrieval-Augmented Generation (RAG) AI technology. This open-source project aims to:

1. **📥 Digitally Preserve** surviving ancient texts and knowledge fragments
2. **🧠 Create an AI System** that can reason with ancient Indian scientific principles
3. **🌍 Make Ancient Wisdom Accessible** to everyone for modern applications
4. **🔬 Bridge Ancient Science** with contemporary challenges

### Why RAG Technology?

RAG (Retrieval-Augmented Generation) is perfect for this mission because:
- It **preserves authenticity** by retrieving exact passages from ancient texts
- It provides **contextual understanding** of complex scientific concepts
- It enables **practical application** of ancient knowledge to modern problems
- It maintains **cultural integrity** while ensuring accessibility

---

## 🎯 The Vision: Ancient Science for Modern Life

Imagine accessing **Nalanda's scientific wisdom** for today's challenges:

- **🏥 Healthcare**: Ayurvedic principles complementing modern medicine
- **🏗️ Architecture**: Vastu-based sustainable building design
- **💰 Economics**: Kautilya's Arthashastra applied to modern business strategy
- **🌱 Agriculture**: Ancient agricultural wisdom for sustainable farming
- **🧠 Psychology**: Yogic and meditative practices for mental wellness
- **⚛️ Physics**: Ancient atomic theories and cosmological models

This isn't about replacing modern science—it's about **integrating proven ancient wisdom** with contemporary knowledge for **holistic solutions**.

### V2.2 Update: SARIT Corpus Integration (March 2026)
We have successfully integrated the ** (Sanskrit Relational Interface)** corpus into the Dharmaganj digital repository. This update adds **60+ high-quality XML manuscripts** across multiple scientific and philosophical domains.

- **Ratnasagara (Technical)**: Added 45+ treatises on Ayurveda (Cikitsavidya), Nyaya (Logic), Vyakarana (Grammar), and Arthashastra (Statecraft).
- **Ratnaranjaka (Narrative)**: Added Puranas and classical Kavya (Poetry/Drama).
- **Ratnodadhi (Foundational)**: Added Yoga Sutras, Advaita treatises, and foundational philosophical texts.

All new data is stored in the `dharmaganj/` directory structure with full metadata in `bagdevibhandar/master_catalog.json`.

### V2.3 Update: Sacred Texts Hindu Collection (March 2026)
Successfully integrated **70 Hindu texts** from the Internet Sacred Text Archive (sacred-texts.com). This comprehensive collection adds primary Hindu scriptures, philosophical treatises, and classical literature to our digital library.

**Collection Details:**
- **Source**: https://www.sacred-texts.com/hin/index.htm
- **Total Texts Fetched**: 70 (88.6% success rate)
- **Storage**: `sacred_texts_hindu/` directory organized by category
- **Metadata**: `sacred_texts_hindu/metadata.json` tracks all fetch operations

All texts are extracted to plain text format and organized by category for easy integration into the RAG system.

**Sacred Texts Hindu Collection - Complete Inventory (70 Texts):**

#### The Vedas (10 texts)
1. Rig Veda (Ralph Griffith translation)
2. Rig-Veda (Sanskrit - Devanagari & Romanized)
3. Vedic Hymns, Part I (SBE 32)
4. Vedic Hymns, Part II (SBE 46)
5. A Vedic Reader for Students (A.A. Macdonell)
6. The Sama-Veda (Ralph Griffith)
7. The Yajur Veda (Taittiriya Sanhita - Arthur Berriedale Keith)
8. The Texts of the White Yajurveda (Ralph T.H. Griffith)
9. The Hymns of the Atharvaveda
10. The Atharva-Veda (SBE 42)

#### Upanishads (5 texts)
1. The Upanishads (Complete - Max Müller)
2. The Upanishads, Part I (SBE 1)
3. The Upanishads, Part II (SBE 15)
4. Thirty Minor Upanishads (K. Narayanasvami Aiyar)
5. From the Upanishads (Charles Johnston)

#### Puranas (6 texts)
1. The Vishnu Purana (H.H. Wilson)
2. The Garuda Purana (Ernest Wood & S.V. Subrahmanyam)
3. The S'rimad Devî Bhâgawatam (Swami Vijnanananda)
4. The Devî Gita (Swami Vijnanananda)
5. The Prem Sagur/Prem Sagar (Lallu Lal - W. Hollings)
6. Kundalini: The Mother of the Universe (Rishi Singh Gherwal)

#### Other Primary Texts (9 texts)
1. The Laws of Manu (George Bühler)
2. The Sacred Laws of the Âryas, Part I (SBE 2)
3. The Sacred Laws of the Âryas, Part II (SBE 14)
4. The Institutes of Vishnu (SBE 7)
5. The Minor Law Books (SBE 33)
6. Satapatha Brahmana, Part I (SBE 12)
7. Satapatha Brahmana, Part II (SBE 26)
8. Satapatha Brahmana, Part III (SBE 41)
9. Satapatha Brahmana, Part IV (SBE 43)
10. Satapatha Brahmana, Part V (SBE 44)
11. The Grihya Sutras, Part 1 (SBE 29)
12. The Grihya Sutras, Part 2 (SBE 30)

#### The Epics (7 texts)
1. The Mahabharata (Complete translation)
2. The Mahabharata in Sanskrit (Devanagari & Romanized)
3. Rámáyan Of Válmíki (Ralph T. H. Griffith)
4. The Ramayana in Sanskrit (Devanagari & Romanized)
5. The Ramayana and Mahabharata (Abridged - R. Dutt)
6. Indian Idylls (Sir Edwin Arnold)
7. Love and Death (Sri Arobindo)

#### Bhagavad Gita (5 texts)
1. The Bhagavadgîtâ (SBE 8 - Kâshinâth Trimbak Telang)
2. The Bhagavad Gita in Sanskrit (Romanized)
3. Srimad-Bhagavad-Gita (Swami Swarupananda)
4. The Bhagavad Gita (International Gita Society)
5. The Bhagavad Gita (Sir Edwin Arnold - Poetic)

#### Vedanta (6 texts)
1. The Vedântâ-Sûtras with Râmânuja commentary (SBE 48)
2. The Vedântâ-Sûtras Part I with Sankarâkârya commentary (SBE 34)
3. The Vedântâ-Sûtras Part II with Sankarâkârya commentary (SBE 38)
4. The Crest-Jewel of Wisdom (Śankarâchârya - Charles Johnston)
5. Brahma-Knowledge (L.D. Barnett)
6. Select Works of Sri Sankaracharya (S. Venkataramanan)

#### Later Texts (12 texts)
1. The Yoga Sutras of Patanjali (Alternative translation)
2. The Hatha Yoga Pradipika (Pancham Sinh)
3. The Sánkhya Aphorisms of Kapila (James R. Ballantyne)
4. The Little Clay Cart (Shudraka - Arthur W. Ryder)
5. Verses of Vemana (Vemana - C.P. Brown)
6. Hymns of the Tamil Saivite Saints (F. Kingsbury & G.P. Phillips)
7. Songs of Kabîr (Rabindranath Tagore)
8. Yoga Vashisht or Heaven Found (Rishi Singh Gherwal)

#### Modern Books & Classical Literature (9 texts)
1. Karma-Yoga (Swami Vivekananda)
2. Hindu Mysticism
3. Writings of Sister Nivedita (Margaret E. Noble)
4. Kali the Mother
5. The Web of Indian Life
6. Studies from an Eastern Home
7. Writings of Rabindranath Tagore (Complete)
8. Gitanjali (Rabindranath Tagore)
9. Saddhana, The Realisation of Life (Rabindranath Tagore)
10. The Crescent Moon (Rabindranath Tagore)
11. Fruit-Gathering (Rabindranath Tagore)
12. Stray Birds (Rabindranath Tagore)
13. The Home and the World (Rabindranath Tagore)
14. Thought Relics (Rabindranath Tagore)
15. The Indian Stories of F.W. Bain

**Data Organization:**
```
sacred_texts_hindu/
├── Vedas/                          # 10 Vedic texts
├── Upanishads/                     # 5 Upanishadic texts
├── Puranas/                        # 6 Puranic texts
├── Primary Texts/                  # 9 Dharmaśāstra & Brahmana texts
├── Epics/                          # 7 Epic texts (Mahabharata, Ramayana)
├── Bhagavad Gita/                  # 5 Gita translations
├── Vedanta/                        # 6 Vedantic philosophical texts
├── Later Texts/                    # 12 Classical & yogic texts
├── Modern Books/                   # 9 Modern & contemporary texts
└── metadata.json                   # Complete fetch status & URLs
```

## 🗄️ Reconstructing the Nalanda Library: Our Digital Corpus

This system begins with the magnificent **Itihāsa dataset**—a fragment of the vast knowledge that once filled Nalanda's halls. This monumental corpus is detailed in the 2021 research paper: "Itihāsa: A large-scale corpus for Sanskrit to English translation".

### Current Digital Collection (Dashboard V2.4 - Updated March 2026):

**Primary Dataset Highlights:**
- **� The Ramayana**: 17,179 verses (within `itihasa_corpus_v2_part_1.txt`)
- **⚔️ The Mahabharata**: 68,710 verses (across `itihasa_corpus_v2_part_1-5.txt`)
- **🕉️ Bhagavad Gita**: Sample verses integrated for philosophical grounding.
- **� SARIT Corpus**: 62 high-quality XML manuscripts on Medicine, Logic, and Grammar.

## 📚 Library Inventory - Complete Collection with Descriptions

### Ratnodadhi (Core/Sacred Texts - Foundation of Hindu Philosophy)

**Shruti (Vedas) - 8 texts**
- **Rig Veda** - The oldest and most important Veda; collection of 1,028 hymns praising Vedic deities and describing cosmology, rituals, and philosophical concepts
- **Sama Veda** - The "Veda of Melodies"; hymns from Rig Veda arranged for liturgical chanting during Soma sacrifices
- **Yajur Veda** - The "Veda of Sacrifices"; detailed instructions for performing Vedic rituals and sacrificial ceremonies
- **Atharva Veda** - The "Veda of Incantations"; contains spells, charms, medical knowledge, and metaphysical teachings

**Upanishads - 5 texts**
- **The Upanishads (Complete)** - Philosophical treatises exploring the nature of Brahman (ultimate reality), Atman (self), and the relationship between the two; foundation of Vedantic philosophy
- **Thirty Minor Upanishads** - Shorter Upanishadic texts focusing on Yogic practices, meditation, and spiritual realization
- **From the Upanishads** - Selected passages from major Upanishads (Katha, Prasna, Chandogya) with commentary

**Bhagavad Gita - 5 texts**
- **The Bhagavadgîtâ (SBE 8)** - Sacred dialogue between Lord Krishna and warrior Arjuna; teaches Dharma (duty), Bhakti (devotion), and paths to liberation
- **Srimad-Bhagavad-Gita** - Modern translation with Swami Swarupananda's commentary explaining spiritual concepts
- **The Bhagavad Gita (Poetic - Edwin Arnold)** - Classic poetic rendering making the philosophical teachings more accessible

**Puranas - 5 texts**
- **The Vishnu Purana** - Mythology and cosmology centered on Vishnu; includes Krishna legends and descriptions of Hindu cosmology
- **The Garuda Purana** - Teachings on dharma, afterlife, funeral rites, and spiritual practices
- **The S'rimad Devî Bhâgawatam** - Goddess-centered mythology; celebrates the divine feminine principle (Shakti)
- **The Devî Gita** - Philosophical teachings of the Goddess; parallel to Bhagavad Gita but from feminine perspective
- **Kundalini: The Mother of the Universe** - Explores Kundalini Shakti and the Thousand Names of the Goddess (Lalita Sahasranama)

**Sutras & Dharmaśāstra - 12 texts**
- **The Laws of Manu (Manusmriti)** - Ancient legal and ethical code; foundational text for Hindu law and social organization
- **The Sacred Laws of the Âryas** - Dharmaśāstra texts by sages Âpastamba, Gautama, Vasishtha, and Baudhâyana; rules for conduct and ritual
- **The Institutes of Vishnu** - Legal and ethical teachings; includes yogic practices and hymns to the Goddess
- **Satapatha Brahmana (5 parts)** - Detailed explanations of Vedic rituals and their philosophical significance
- **The Grihya Sutras (2 parts)** - Domestic rituals and household ceremonies for different life stages

### Ratnasagara (Technical/Scientific Knowledge)

**Vedanta Philosophy - 5 texts**
- **The Vedântâ-Sûtras with Commentaries** - Systematic philosophical treatises exploring non-dualism (Advaita) and qualified non-dualism (Vishishtadvaita)
- **The Crest-Jewel of Wisdom** - Śankarâchârya's masterwork on Advaita Vedanta; explains the nature of Brahman and liberation
- **Select Works of Sri Sankaracharya** - Collection of philosophical essays and teachings on non-dual reality
- **Brahma-Knowledge** - Exposition of Vedantic philosophy and the path to self-realization

**Yoga & Spiritual Practices - 8 texts**
- **The Yoga Sutras of Patanjali** - Foundational text on Raja Yoga; systematic approach to meditation and mental discipline
- **The Hatha Yoga Pradipika** - Comprehensive guide to physical yoga practices, pranayama (breathing), and chakra system
- **The Sánkhya Aphorisms of Kapila** - Dualistic philosophy explaining the relationship between consciousness (Purusha) and matter (Prakriti)
- **Yoga Vashisht** - Philosophical teachings on liberation through knowledge and meditation
- **Hymns of the Tamil Saivite Saints** - Devotional poetry celebrating Shiva; represents South Indian bhakti tradition
- **Songs of Kabîr** - Mystical poetry bridging Hindu and Islamic traditions; emphasizes direct experience of the divine
- **The Hatha Yoga Pradipika** - Detailed instructions on physical postures, breathing techniques, and energy channels

**Existing Collections in Ratnasagara**
- **Cikitsavidya (Ayurveda)** - 15 texts on traditional Indian medicine, healing practices, and herbal remedies
- **Nyaya Pramana** - 28 texts on logic, epistemology, and methods of valid knowledge
- **Vyakarana** - 2 texts on Sanskrit grammar (Panini's Ashtadhyayi tradition)
- **Arthashastra** - Political science and statecraft by Kautilya
- **Kosha** - 7 texts on Sanskrit lexicography and word meanings
- **Natyashastram** - Treatise on drama, dance, and performing arts
- **Shringaraprakash** - Aesthetic theory and poetics

### Ratnaranjaka (Narrative/Cultural Heritage)

**The Great Epics - 7 texts**
- **The Mahabharata** - World's longest epic poem; tells the story of the Kurukshetra war and includes the Bhagavad Gita; explores dharma, duty, and human nature
- **The Mahabharata in Sanskrit** - Original Sanskrit text with Devanagari and romanized versions for scholars
- **Rámáyan Of Válmíki** - Epic tale of Prince Rama's exile and quest to rescue his wife Sita; teaches ideals of dharma, loyalty, and righteousness
- **The Ramayana in Sanskrit** - Original Sanskrit text preserving the classical language and poetic structure
- **The Ramayana and Mahabharata (Abridged)** - Condensed versions making these vast epics more accessible
- **Indian Idylls** - Poetic renderings of Mahabharata stories by Sir Edwin Arnold
- **Love and Death** - Story of Ruru and Priyumvada from the Mahabharata; explores themes of love and sacrifice

**Classical Literature & Poetry - 15 texts**
- **The Little Clay Cart** - Earliest surviving Indian drama; romantic comedy exploring love, social classes, and virtue
- **Verses of Vemana** - 17th-century Telugu devotional poetry emphasizing spiritual wisdom over ritual
- **The Indian Stories of F.W. Bain** - Modern retellings of classical Indian tales and legends
- **Writings of Rabindranath Tagore** - Nobel laureate's philosophical essays, poetry, and spiritual teachings
- **Gitanjali** - Tagore's collection of devotional poems; celebrates the divine in everyday life
- **Saddhana, The Realisation of Life** - Tagore's essays on spiritual realization and human development
- **The Crescent Moon** - Tagore's poetry collection for children exploring wonder and nature
- **Fruit-Gathering** - Lyrical poems on love, nature, and spiritual truth
- **Stray Birds** - Aphoristic poetry expressing profound philosophical insights in simple language
- **The Home and the World** - Tagore's novel exploring nationalism, tradition, and modernity
- **Thought Relics** - Collection of Tagore's philosophical reflections and meditations
- **Karma-Yoga** - Swami Vivekananda's teachings on selfless action and spiritual work
- **Hindu Mysticism** - Exploration of mystical traditions within Hinduism
- **Writings of Sister Nivedita** - Essays on Hindu culture, women's empowerment, and spiritual practice
- **Kali the Mother** - Philosophical exploration of the Divine Mother principle
- **The Web of Indian Life** - Analysis of Indian society, culture, and spiritual traditions
- **Studies from an Eastern Home** - Essays on Indian philosophy and way of life

**Existing Collections in Ratnaranjaka**
- **Itihasa (Epics)** - 6 texts on the great epics and their philosophical teachings
- **Purana** - 2 texts on mythological narratives and cosmology
- **Kavya** - 7 texts on classical Sanskrit poetry and drama
- **Amarushataka** - 100 verses on love and romance
- **Anyapadesh Shataka** - Didactic poetry on ethical conduct
- **Bhatti Kavya** - Epic poem illustrating Sanskrit grammar
- **Hamsaduta** - Poetic work featuring a swan as messenger
- **Kadambari Sangraha** - Collection of romantic narratives
- **Kathasaritsagara** - Ocean of Stories; vast collection of tales
- **Kiratarjuniya** - Epic poem on Arjuna's encounter with Shiva
- **Kumarasambhava** - Birth of Kumara (Skanda); divine love story
- **Mahasubhashita Sangraha** - Collection of wise sayings and aphorisms
- **Meghaduta** - Cloud Messenger; lyrical poem of separation and longing
- **Naishadhiya Charita** - Epic poem on Nala and Damayanti
- **Nilakantha Vijayachampu** - Poem celebrating Nilakantha (Shiva)
- **Pancatantra** - Fables and moral tales using animal characters
- **Raghuvansha** - Dynasty of Raghu; genealogy of Rama's ancestors
- **Rtusamhara** - Poem describing the six seasons
- **Shakuntala** - Famous drama by Kalidasa; love story with spiritual themes
- **Shataka Traya** - Three centuries of aphoristic verses on ethics and wisdom
- **Shishupala Vadha** - Epic poem on the slaying of Shishupala; 40 texts on various aspects

### Data Structure & Organization

```
nalanda_library/
├── library_metadata.json          # Statistics of our digital reconstruction
├── nalanda_corpus_part_1.txt      # First 20,000 verses (mainly Ramayana)
├── nalanda_corpus_part_2.txt      # Next 20,000 verses (mainly Mahabharata)
├── nalanda_corpus_part_3.txt      # Next 20,000 verses (mainly Mahabharata)
├── nalanda_corpus_part_4.txt      # Next 20,000 verses (mainly Mahabharata)
└── nalanda_corpus_part_5.txt      # Final verses + supplementary texts
```

### This is Just the Beginning

Our current collection represents **less than 1%** of Nalanda's original library. We urgently need to expand:

**Critical Missing Scientific Texts:**
- **🔬 Medical Treatises**: Sushruta Samhita (surgery), Charaka Samhita (medicine)
- **📐 Mathematical Texts**: Aryabhatiya, Brahmasphutasiddhanta, Lilavati
- **🏛️ Architectural Manuals**: Vastu Shastra, Shilpa Shastra
- **⚖️ Political Science**: Kautilya's Arthashastra, Manusmriti
- **🌿 Agricultural Wisdom**: Krishi Parashara, Vrikshayurveda
- **🎭 Arts & Aesthetics**: Natya Shastra, Kamasutra

**Scriptural Expansion Needed:**
- **Complete Bhagavad Gita**: All 700 verses (currently only 2)
- **Major Upanishads**: Complete Katha, Isha, Mundaka, Mandukya, Prashna
- **Complete Vedas**: Rig Veda (10,552 verses), Yajur, Sama, Atharva Vedas

## 🧠 The Digital Nalanda Architecture: How Our RAG System Works

Our AI system mimics the **scholarly methodology** of ancient Nalanda professors:

1. **📚 Knowledge Preservation**: Ancient Sanskrit verses and translations are systematically organized like Nalanda's library sections
2. **🔍 Intelligent Retrieval**: When you seek guidance (e.g., "How did ancient Indians perform surgery?"), the system searches through relevant scientific treatises
3. **🎓 Contextual Teaching**: The AI presents authentic passages with practical explanations, just as Nalanda masters taught their students
4. **🔬 Practical Application**: Ancient principles are connected to modern challenges and solutions

### RAG (Retrieval-Augmented Generation) Architecture

**What is RAG?**

RAG is a hybrid AI approach that combines:
- **Retrieval**: Finding relevant documents/passages from a knowledge base
- **Augmentation**: Using those passages as context for the AI
- **Generation**: Creating informed responses based on retrieved context

**Why RAG for Ancient Wisdom?**

Traditional LLMs can "hallucinate" or provide inaccurate information. RAG ensures:
- ✅ **Authenticity**: Every answer backed by actual ancient texts
- ✅ **Traceability**: Users can see which verses informed the response
- ✅ **Accuracy**: Reduces AI errors through grounding in real sources
- ✅ **Cultural Integrity**: Preserves original meanings and context

### System Architecture Flow

```
User Query
    ↓
┌─────────────────────────────────────┐
│  1. RETRIEVAL PHASE                 │
│  ─────────────────────────────────  │
│  • Search Vedic corpus              │
│  • Match keywords & semantics       │
│  • Rank by relevance               │
│  • Return top N passages           │
└─────────────────────────────────────┘
    ↓
┌─────────────────────────────────────┐
│  2. AUGMENTATION PHASE              │
│  ─────────────────────────────────  │
│  • Build context from passages      │
│  • Add metadata (source, category)  │
│  • Format for LLM input            │
│  • Create enriched prompt          │
└─────────────────────────────────────┘
    ↓
┌─────────────────────────────────────┐
│  3. GENERATION PHASE                │
│  ─────────────────────────────────  │
│  • Send prompt to Ollama LLM        │
│  • Generate response using context  │
│  • Cite source verses              │
│  • Provide practical insights      │
└─────────────────────────────────────┘
    ↓
Comprehensive Answer with Sources
```

### Component Details

#### 1. **Knowledge Base (Corpus)**
- **Location**: `nalanda_library/`, `dharmaganj/`, `sacred_texts_hindu/`
- **Format**: Structured text files with metadata
- **Size**: 183+ documents, 85,895+ verses
- **Organization**: By domain (medicine, philosophy, epics, etc.)

#### 2. **Retrieval Engine** (`simple_rag_demo.py`)
```python
class VedicRAGDemo:
    def search_verses(query, max_results=5):
        # Keyword-based search with relevance scoring
        # Searches: verse content, category, source
        # Returns: ranked list of relevant passages
```

**Retrieval Strategy:**
- **Keyword Matching**: Exact word matches in verse content
- **Category Matching**: Searches document categories (2x weight)
- **Source Matching**: Searches scripture names (2x weight)
- **Relevance Scoring**: Combines all matches into single score
- **Ranking**: Returns top N results by score

#### 3. **LLM Integration** (`ollama_rag_ui.py`)
- **Model**: Ollama (local, private, no API keys)
- **Supported Models**: Mistral, Neural-Chat, Llama2, Dolphin-Mixtral
- **Connection**: HTTP API to local Ollama server
- **Temperature**: 0.7 (balanced creativity/accuracy)

#### 4. **User Interface** (Streamlit)
- **Framework**: Streamlit (modern web UI)
- **Features**:
  - Real-time model selection
  - Configurable retrieval parameters
  - Verse visualization with Sanskrit/English
  - Conversation history saving
  - Connection status monitoring

## 🚀 Key Features of Digital Nalanda

- **📖 Scientific Authenticity**: Every insight backed by original Sanskrit verses with accurate translations
- **🔬 Practical Applications**: Ancient scientific principles adapted for modern technology, medicine, and governance
- **🌍 Comprehensive Coverage**: Multiple domains from mathematics to medicine, astronomy to architecture
- **💻 Interactive Learning**: Command-line interface and ready-to-use files for various RAG systems
- **🏛️ Cultural Preservation**: Helping reconstruct and preserve India's invaluable scientific heritage

## 🎯 Nalanda's Scientific Domains for Modern Applications

Our system illuminates these areas where ancient Indian science can transform modern life:

- **🏥 Advanced Medicine**: Surgical techniques from Sushruta Samhita, holistic healing from Charaka Samhita
- **📐 Mathematical Excellence**: Vedic mathematics, zero and decimal systems, astronomical calculations
- **🏗️ Sustainable Architecture**: Earthquake-resistant designs, climate-responsive buildings, sacred geometry
- **⚖️ Ethical Governance**: Dharma-based political science, just economic systems, social welfare principles
- **🌱 Ecological Wisdom**: Sustainable agriculture, water conservation, environmental harmony
- **🧠 Cognitive Science**: Meditation techniques, psychological insights, consciousness studies

## 🚀 Digital Nalanda Applications: Transforming Modern Life

Our RAG system enables revolutionary applications that bridge ancient Indian science with contemporary challenges:

### 1. **🏥 Nalanda Medical AI**
- **Concept**: Apply Sushruta's surgical techniques and Charaka's diagnostic methods to modern healthcare
- **Applications**: AI-assisted surgery planning, personalized medicine, preventive healthcare
- **Value**: Integrates time-tested holistic approaches with modern medical science

### 2. **📐 Vedic Mathematics Engine**
- **Concept**: Implement Aryabhata's and Brahmagupta's computational methods in modern algorithms
- **Applications**: High-speed computing, cryptography, astronomical calculations
- **Value**: Ancient efficiency techniques for modern computational challenges

### 3. **🏗️ Sustainable Architecture Advisor**
- **Concept**: Use Vastu Shastra principles for climate-responsive, earthquake-resistant design
- **Applications**: Green building design, urban planning, disaster-resistant construction
- **Value**: Ancient sustainability wisdom for modern environmental challenges

### 4. **⚖️ Dharma Governance Framework**
- **Concept**: Apply Kautilya's Arthashastra and Dharmashastra to modern governance
- **Applications**: Ethical AI systems, corporate governance, policy making
- **Value**: Time-tested ethical frameworks for modern institutions

### 5. **🌱 Ecological Intelligence System**
- **Concept**: Integrate ancient agricultural and environmental wisdom with modern ecology
- **Applications**: Sustainable farming, water management, biodiversity conservation
- **Value**: Proven environmental harmony principles for climate action

## 📱 The Nalanda Digital Platform: "Ancient Science for Modern Problems"

We're building a comprehensive platform that makes Nalanda's knowledge accessible to everyone:

### Core Features:
- **🎓 Interactive Learning**: AI tutors that teach using Nalanda's pedagogical methods
- **🔬 Research Assistant**: Help scholars apply ancient principles to modern research
- **💡 Innovation Engine**: Connect ancient solutions to contemporary problems
- **🌍 Cultural Bridge**: Explain complex modern concepts through ancient analogies
- **📚 Knowledge Repository**: Searchable database of ancient scientific treatises

---

## 🛠️ Join the Reconstruction: Getting Started

### Prerequisites

- **Python 3.9+**
- **Internet connection** for dataset download
- **Ollama** (for LLM-powered RAG interface)
- **Docker** (optional, for containerized deployment)
- Passion for preserving ancient scientific wisdom

---

## 📋 Setup Instructions

### Option A: Local Setup (Recommended for Development)

#### Step 1: Install Python Dependencies

```bash
# Clone the repository
git clone https://github.com/yourusername/digital-nalanda-university.git
cd digital-nalanda-university

# Create virtual environment (optional but recommended)
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install dependencies
pip install -r requirements.txt
```

#### Step 2: Download Ancient Knowledge

```bash
python VedicDatasetGenerator.py
```

This creates the `nalanda_library/` directory with:
- 85,895+ verses from ancient texts
- Structured metadata for RAG retrieval
- Multiple corpus parts for efficient loading

**Output Structure:**
```
nalanda_library/
├── dataset_metadata.json
├── nalanda_corpus_part_1.txt
├── nalanda_corpus_part_2.txt
├── nalanda_corpus_part_3.txt
├── nalanda_corpus_part_4.txt
└── nalanda_corpus_part_5.txt
```

#### Step 3: Test the RAG System Locally

```bash
# Test basic RAG functionality
python test_rag.py

# Interactive command-line RAG
python simple_rag_demo.py
```

**Sample Queries:**
- "courage"
- "duty and righteousness"
- "wisdom and knowledge"
- "leadership"
- "peace and meditation"

---

### Option B: RAG with Ollama (Full AI-Powered System)

#### Step 1: Install Ollama

Download from: https://ollama.ai

#### Step 2: Pull an LLM Model

```bash
# Recommended: Mistral (7B, balanced speed/quality)
ollama pull mistral

# Alternatives:
ollama pull neural-chat      # Smaller, faster
ollama pull llama2           # Larger, more capable
ollama pull dolphin-mixtral  # Specialized
```

#### Step 3: Start Ollama Server

```bash
ollama serve
```

Server runs on `http://localhost:11434`

#### Step 4: Run the Streamlit RAG UI

```bash
streamlit run ollama_rag_ui.py
```

Opens at `http://localhost:8501`

**Features:**
- ✅ Real-time model selection
- ✅ Configurable verse retrieval
- ✅ Beautiful verse visualization
- ✅ Conversation history saving
- ✅ Connection status monitoring

---

### Option C: Docker Deployment (Production)

#### Step 1: Build and Run Containers

```bash
cd Docker\ Code
docker compose up --build
```

**Services Started:**
- ChromaDB (vector database): `http://localhost:8000`
- FastAPI (RAG backend): `http://localhost:8080`

#### Step 2: Ingest Data into ChromaDB

```bash
docker exec -it nalanda-api python ingest.py
```

This:
- Reads documents from `./data`
- Generates embeddings via Ollama
- Stores in ChromaDB with vector search

#### Step 3: Query the API

```bash
curl -X POST http://localhost:8080/query \
  -H "Content-Type: application/json" \
  -d '{"query": "ancient surgical techniques"}'
```

---

## 🎯 Quick Start Comparison

| Method | Setup Time | Best For | Features |
|--------|-----------|----------|----------|
| **Local RAG** | 5 min | Development, Testing | Simple, fast, no LLM |
| **Ollama RAG** | 15 min | Interactive Use | AI-powered, beautiful UI |
| **Docker** | 20 min | Production, API Access | Scalable, vector search |

---

## 🚀 Begin Your Journey

### 1. **Quick Test** (5 minutes)
```bash
pip install -r requirements.txt
python VedicDatasetGenerator.py
python test_rag.py
```

### 2. **Interactive Exploration** (10 minutes)
```bash
python simple_rag_demo.py
```

### 3. **Full AI Experience** (20 minutes)
```bash
# Terminal 1: Start Ollama
ollama serve

# Terminal 2: Run Streamlit UI
streamlit run ollama_rag_ui.py
```

### 4. **Production Deployment** (30 minutes)
```bash
cd Docker\ Code
docker compose up --build
docker exec -it nalanda-api python ingest.py
```

---

## 📊 System Architecture Comparison

### Local RAG (`simple_rag_demo.py`)
```
User Query
    ↓
Keyword Search (in-memory)
    ↓
Retrieve Verses
    ↓
Format Response
    ↓
Display Results
```
**Pros**: Fast, no dependencies, offline
**Cons**: No AI, basic keyword matching

### Ollama RAG (`ollama_rag_ui.py`)
```
User Query
    ↓
Keyword Search
    ↓
Retrieve Verses
    ↓
Build Prompt with Context
    ↓
Ollama LLM Generation
    ↓
Display with Sources
```
**Pros**: AI-powered, beautiful UI, context-aware
**Cons**: Requires Ollama, slower

### Docker RAG (`Docker Code/`)
```
User Query
    ↓
FastAPI Endpoint
    ↓
Vector Search (ChromaDB)
    ↓
Retrieve Embeddings
    ↓
Ollama LLM
    ↓
JSON Response
```
**Pros**: Scalable, API-based, semantic search
**Cons**: Complex setup, requires Docker

---

## 🔧 Configuration Guide

### Ollama RAG Settings

**In `ollama_rag_ui.py` sidebar:**

1. **Ollama Server URL**
   - Default: `http://localhost:11434`
   - Change if Ollama runs on different host/port

2. **Model Selection**
   - Mistral: Balanced (7B)
   - Neural-Chat: Fast (7B)
   - Llama2: Capable (13B)
   - Dolphin-Mixtral: Specialized (8x7B)

3. **RAG Settings**
   - **Max Verses**: 1-10 (default: 3)
   - **Use RAG Context**: Toggle on/off

### Performance Tuning

**For Speed:**
```python
# Use smaller model
ollama pull neural-chat

# Reduce verses
max_verses = 1

# Disable RAG
use_rag = False
```

**For Quality:**
```python
# Use larger model
ollama pull llama2

# Increase verses
max_verses = 5

# Enable RAG
use_rag = True
```

---

## 🐛 Troubleshooting

### "Cannot connect to Ollama"
- Ensure Ollama is running: `ollama serve`
- Check URL is correct (default: `http://localhost:11434`)
- On Windows, Ollama may run as background service

### "No models found"
- Pull a model: `ollama pull mistral`
- List models: `ollama list`

### "Dataset not found"
- Run: `python VedicDatasetGenerator.py`
- Check `nalanda_library/` directory exists

### "Request timeout"
- Model is slow to respond
- Try smaller model: `ollama pull neural-chat`
- Reduce `max_verses` setting

### Docker Issues
- Remove old containers: `docker compose down -v`
- Rebuild: `docker compose up --build`
- Check logs: `docker compose logs -f`

---

## 📚 File Organization

```
Code Workspace/
├── README.md                          # This file
├── requirements.txt                   # Python dependencies
├── simple_rag_demo.py                # Basic RAG system
├── test_rag.py                       # Test suite
├── ollama_rag_ui.py                  # Streamlit UI
├── OLLAMA_RAG_SETUP.md               # Ollama setup guide
│
├── nalanda_library/                  # Ancient texts corpus
│   ├── dataset_metadata.json
│   └── nalanda_corpus_part_*.txt
│
├── dharmaganj/                       # SARIT corpus
│   ├── ratnasagara/
│   ├── ratnaranjaka/
│   └── ratnodadhi/
│
├── sacred_texts_hindu/               # Hindu texts collection
│   ├── Vedas/
│   ├── Upanishads/
│   ├── Puranas/
│   └── metadata.json
│
└── Docker Code/                      # Production deployment
    ├── docker-compose.yml
    ├── Dockerfile
    ├── main.py
    ├── ingest.py
    └── README.md
```

---

## 🎓 Begin Your Journey

### 1. **Quick Test** (5 minutes)
```bash
pip install -r requirements.txt
python VedicDatasetGenerator.py
python test_rag.py
```

### 2. **Interactive Exploration** (10 minutes)
```bash
python simple_rag_demo.py
```

### 3. **Full AI Experience** (20 minutes)
```bash
# Terminal 1: Start Ollama
ollama serve

# Terminal 2: Run Streamlit UI
streamlit run ollama_rag_ui.py
```

### 4. **Production Deployment** (30 minutes)
```bash
cd Docker\ Code
docker compose up --build
docker exec -it nalanda-api python ingest.py
```

## 📁 The Digital Library Structure

### Current Collection Summary:
- **Total Verses:** 85,895 (of 9,000,000+ original manuscripts)
- **Primary Sources:** Itihasa Corpus (85,889 verses)
  - Ramayana: 17,179 verses
  - Mahabharata: 68,710 verses
- **Supplementary Sources:** 6 verses
  - Bhagavad Gita: 2 verses (needs expansion to 700)
  - Upanishads: 2 verses (Isha, Katha samples)
  - Vedas: 2 verses (Rig, Yajur samples)

### Data Format for RAG System

Each verse follows this structured format:
```
Source: Itihasa
Category: Mahabharata
Title: Verse 1
Verse: 1
Sanskrit: [Original Sanskrit text]
English: [Precise English translation]
---
```

This structure enables:
- **Precise retrieval** by source, category, or verse number
- **Contextual understanding** with metadata
- **Scalable expansion** for new texts
- **RAG optimization** with clean formatting

## 🧠 Accessing Nalanda's Wisdom

### Interactive Exploration:
```bash
python simple_rag_demo.py
```

Explore questions like:
- "How did ancient Indians perform cataract surgery?"
- "What mathematical techniques did Aryabhata use for astronomy?"
- "How can Vastu principles create sustainable buildings?"
- "What governance systems did Kautilya propose?"

### OpenUI Integration:
The text files in `nalanda_library/` are ready for modern RAG systems. Each passage follows this scholarly format:
```
Source: Itihasa
Category: Mahabharata
Title: Verse 1
Verse: 1
Sanskrit: [Original Sanskrit scientific treatise]
English: [Precise translation preserving technical accuracy]
---
```

### Programmatic Access:
```python
from simple_rag_demo import NalandaRAG

rag = NalandaRAG()
wisdom = rag.generate_response("ancient surgical techniques for rhinoplasty")
print(wisdom)
```

---

## 🤝 Join the Reconstruction: Global Open Source Initiative

**This is humanity's shared heritage**—we invite everyone to help rebuild Nalanda University digitally!

### Who Can Contribute:

- **👨‍💻 Developers**: Build AI systems, improve algorithms, create interfaces
- **� Scholars**: Translate texts, provide context, verify accuracy
- **🔬 Scientists**: Apply ancient principles to modern research
- **🏛️ Historians**: Document historical context, preserve cultural integrity
- **🌍 Global Citizens**: Share knowledge, test applications, provide feedback
- **� Designers**: Create beautiful interfaces for knowledge access

### Urgent Reconstruction Areas:

- **📖 Text Digitization**: Help digitize remaining ancient manuscripts
- **🔬 Scientific Validation**: Test ancient techniques with modern science
- **� Platform Development**: Build user interfaces for different domains
- **🌐 Multilingual Support**: Make knowledge accessible in all languages
- **� Research Integration**: Connect ancient wisdom with modern research
- **🎓 Educational Tools**: Create learning modules for schools and universities

### How to Join the Reconstruction:

1. **� Fork this repository** and become a Nalanda reconstruction scholar
2. **📚 Choose your domain** - medicine, mathematics, architecture, governance, etc.
3. **🔬 Contribute knowledge** - add texts, improve translations, validate applications
4. **💻 Build tools** - create interfaces, algorithms, educational materials
5. **🤝 Collaborate globally** - work with scholars worldwide
6. **� Share your work** - submit pull requests and help expand the library

---

## 🌍 The Impact: Why This Matters

### Reclaiming Scientific Heritage
- **Correct Historical Narratives**: Show India's true scientific contributions
- **Inspire Modern Innovation**: Ancient principles can solve today's problems
- **Cultural Renaissance**: Revitalize pride in indigenous knowledge systems

### Practical Benefits for Humanity
- **🏥 Better Healthcare**: Integrating holistic healing with modern medicine
- **� Sustainable Living**: Ancient ecological wisdom for climate action
- **⚖️ Ethical Progress**: Time-tested governance for modern challenges
- **🧠 Cognitive Enhancement**: Ancient techniques for mental wellness

### Educational Transformation
- **📚 Complete Curriculum**: From primary to university level
- **🔬 Research Integration**: Ancient principles in modern research
- **🌍 Accessible Knowledge**: Free, open-source for everyone

---

## 📜 Historical Context: The Tragedy and The Renaissance

### What Was Lost in 1197 CE

When Bakhtiyar Khilji destroyed Nalanda, humanity lost:
- **Centuries of accumulated scientific knowledge**
- **Medical advances that could have saved millions**
- **Mathematical concepts that advanced human civilization**
- **Philosophical systems that promoted harmony and wisdom**
- **Architectural knowledge for sustainable living**

### Our Digital Renaissance

Today, we have the technology to **reconstruct what was destroyed**:
- **AI can organize and connect** vast knowledge systems
- **Digital preservation** ensures this knowledge can never be destroyed again
- **Global collaboration** accelerates reconstruction
- **Modern science validates** ancient principles

---

## 📄 License and Philosophy

This project is **open-source under the MIT License** because:

- **Knowledge belongs to humanity** - no one can patent ancient wisdom
- **Collaboration accelerates progress** - together we rebuild faster
- **Access must be universal** - everyone deserves this knowledge
- **Preservation requires openness** - closed systems can be destroyed

The ancient texts themselves are **humanity's shared heritage** - they were freely shared in Nalanda's halls, and they shall be freely shared in our digital reconstruction.

---

## 🆘 Support and Community

### Get Help:
1. **📖 Check our documentation** and troubleshooting guides
2. **💬 Join our community discussions** on GitHub
3. **📧 Contact our team** for technical support
4. **🎓 Attend our workshops** and webinars

### Common Issues:

**Challenge**: ModuleNotFoundError for 'datasets'
**Solution**: `pip install datasets huggingface_hub`

**Challenge**: Large file memory concerns
**Solution**: Our library is organized in manageable segments

**Challenge**: Understanding Sanskrit technical terms
**Solution**: Each passage includes context and explanations

---

## � The Journey Begins: Be Part of History

**You are not just contributing code** - you are helping rebuild one of humanity's greatest treasures.

Every line of code, every translated verse, every validated principle helps restore what was lost in 1197 CE. Together, we can create a **Digital Nalanda that serves humanity for centuries to come**.

### Quick Start Commands:
```bash
# Prepare your environment
pip install -r requirements.txt

# Download ancient knowledge
python VedicDatasetGenerator.py

# Test the system
python test_rag.py

# Begin your journey as a Nalanda scholar
python simple_rag_demo.py
```

---

**🏛️ Join us in this historic mission to rebuild Nalanda University digitally!**

*Together, we shall restore the light of ancient knowledge and illuminate the path forward for all humanity.* 🙏

---

*"The destruction of Nalanda was a tragedy for human civilization. Its digital reconstruction shall be our triumph."*

VedicRAG_AI

VedicRAG_AI Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

VedicRAG_AI

VedicRAG_AI Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README