ia3

chatglm 6b finetuning and alpaca finetuning

qwen models finetuning

Exploratory code for circuit-localized, two-stage IA3 knowledge editing in Phi-3; companion artifact to arXiv:2508.07075.

Fine-tuned chemical language model for predicting molecular lipophilicity in drug design. Explores parameter-efficient fine-tuning strategies (LoRA, BitFit, IA3), layer freezing techniques, and influence-based data selection. Balances accuracy and computational efficiency for molecular property prediction tasks.

Experiments on optimizing of Large Language Models (LLMs) using Parameter Efficient Fine-Tuning (PEFT) with techniques like LORA and IA3 for faster inference and reduced memory usage.

ESM-2 and IA3 parameter-efficient functional peptide classification with a Streamlit inference demo

Benchmarking QLoRA, DoRA and IA3 vs RAG on Llama-3.2-3B for legal contract risk analysis — 4-layer evaluation framework with statistical significance testing