Reorganize documentation: Move docs to doc/CodeDocs for clarity

- Moved docs/ folder to doc/CodeDocs/ to better organize documentation
- Updated GitHub Actions workflow to use new path (doc/CodeDocs/)
- Updated .gitignore to reflect new documentation paths
- Updated README.md to document the new structure
- Added README.md in CodeDocs explaining its purpose and relationship to main docs
- This provides clear separation between auto-generated API docs (CodeDocs)
  and human-written documentation (architecture, business, guides in doc/)

Author: vinod0m

.github/workflows/python-docs.yml

@@ -26,10 +26,10 @@ jobs:
           install-docs-reqs: 'true'
       - name: Generate Sphinx docs
         run: |
-          sphinx-apidoc -o docs/ src/
-          sphinx-build -b html docs/ docs/_build/html
+          sphinx-apidoc -o doc/CodeDocs/ src/
+          sphinx-build -b html doc/CodeDocs/ doc/CodeDocs/_build/html
       - name: Upload documentation artifact
         uses: actions/upload-artifact@v4
         with:
           name: sphinx-docs
-          path: docs/_build/html
+          path: doc/CodeDocs/_build/html

.gitignore

@@ -297,11 +297,11 @@ coverage.xml
 
 #Ignore vscode AI rules
 .github/instructions/codacy.instructions.md
-docs/_build/
+doc/CodeDocs/_build/
 # Generated API documentation files
-docs/modules.rst
-docs/app.rst
-docs/llm.rst
-docs/parsers.rst
-docs/parsers.database.rst
-docs/utils.rst
+doc/CodeDocs/modules.rst
+doc/CodeDocs/app.rst
+doc/CodeDocs/llm.rst
+doc/CodeDocs/parsers.rst
+doc/CodeDocs/parsers.database.rst
+doc/CodeDocs/utils.rst

README.md

@@ -161,7 +161,7 @@ If you would like to contribute to the documentation, please submit a pull reque
 📁 notebooks/    → Quick experiments and prototyping
 📁 src/          → The core engine — all logic lives here (./src/README.md)
 📁 tests/        → Unit, integration, and end-to-end tests
-📁 docs/         → Architecture, schema, guides
+📁 doc/          → Architecture, schema, guides, and API documentation (doc/CodeDocs/)
 📁 deployments/  → Docker, Kubernetes, Helm, monitoring
 ```
 

doc/CodeDocs/README.md

@@ -0,0 +1,42 @@
+# Code Documentation (CodeDocs)
+
+This directory contains the auto-generated API documentation for the unstructuredDataHandler project using Sphinx.
+
+## Contents
+
+- `conf.py` - Sphinx configuration file
+- `index.rst` - Main documentation index
+- `_static/` - Static files for documentation (CSS, images, etc.)
+- `_templates/` - Custom documentation templates
+- `_build/` - Generated HTML documentation (auto-generated, not committed)
+- `*.rst` - Auto-generated API documentation files (not committed)
+
+## Building Documentation
+
+To build the documentation locally:
+
+```bash
+# Install documentation dependencies
+pip install -r requirements-docs.txt
+
+# Generate API documentation
+sphinx-apidoc -o doc/CodeDocs/ src/
+
+# Build HTML documentation
+sphinx-build -b html doc/CodeDocs/ doc/CodeDocs/_build/html
+```
+
+The built documentation will be available in `doc/CodeDocs/_build/html/index.html`.
+
+## Automated Builds
+
+The documentation is automatically built and updated via GitHub Actions on every push that modifies Python files. See `.github/workflows/python-docs.yml` for the CI configuration.
+
+## Relationship to Main Documentation
+
+This CodeDocs directory focuses specifically on API documentation generated from source code docstrings. For other types of documentation:
+
+- Architecture documentation → `doc/architecture/`
+- Business documentation → `doc/business/`  
+- General guides and specs → `doc/`
+- Images and references → `doc/images/`, `doc/reference/`