This project is inspired by the Deep Red film trilogy from the creators of "Iron Sky". It aims to create a custom LLM model that has only knowledge up to July 1969 - the launch date of the fictional Mars mission in the movie - and responds in a style that aligns with a "Soviet utopia" setting controlled by the fictional "chess playing" AI.
- How to setup an AMD "Strix Halo" device
- How to setup LMStudio as server for "headless" operation
- How to create a Wikipedia database, enable vector database searches for articles, and provide an MCP server for the data
- How to extract temporal information from YAGO about Wikipedia articles
- How to normalize YAGO output to match local English Wikipedia database
- How to extract temporal information from Wikidata
- How to augment the Wikipedia database with temporal information
- How to fine-tune an existing LLM model with a Temporal Knowledge Cutoff, restating its knowledge base into the past
- Temporal Finetuning Phased Plan - Content retrieval, analysis, and finetuning for temporal alignment
- How to generate training datasets
- How to finetune model with temporal knowledge cutoff using these datasets
- How to fine-tune the model further for "Soviet utopia" theme alignment
- Theme Finetuning Phased Plan - Content retrieval, analysis, and finetuning for stylistic alignment
- Phase 1: How to retrieve training content from Project Gutenberg
- Phase 2: How to chunk and filter content for theme alignment
- Phase 3: How to generate ChatML training dataset from filtered content
- Phase 4: How to finetune model with themed dataset
/documentation- Setup guides and planning documents for the project/scripts- Python scripts for Wikipedia extraction, processing, indexing, YAGO parsing, Wikidata parsing, and the MCP server/services- Systemd service files for automated startup (LMStudio, MCP server, OpenSearch, web GUI)/webapp- React-based web interface for Wikipedia search with Vite configuration/notebooks- Jupyter notebooks for testing embeddings and OpenSearch functionality/patches- System patches (network driver fix for AMD Strix Halo)