dragonfarm - Fine-Tune Language Models with LoRA on Your Documents and Data

Fine-tune causal language models with LoRA (Low-Rank Adaptation) from R, and answer questions from your own documents. Documents (PDF, Word, HTML, Markdown, spreadsheets, web pages) are read into chunks, retrieved for each question by combined keyword and embedding search, and answered with cited sources; a model can then write training questions from them for review. Tables of prompts and responses work too. Training runs in a background 'Python' process built on Hugging Face 'transformers' and 'peft', with 4-bit loading (QLoRA) so a 7-billion-parameter model trains on an 8 GB GPU, and a 'shiny' app covers the whole workflow. 'Python' dependencies are declared through 'reticulate' and resolved automatically on first use.