LoRA (Low-Rank Adaptation) is a fine-tuning method introduced by Hu et al. at Microsoft in 2021. Instead of updating all billions of parameters in a large model, LoRA freezes the original weights and injects trainable low-rank matrices into each transformer layer. The insight: weight updates during fine-tuning have low "intrinsic rank", most of the useful signal lives in a much smaller…

Read more →

Prompt engineering is the discipline of communicating effectively with large language models. Because LLMs are trained to predict plausible continuations of text, how you frame a request has an enormous impact on what you get back, the same underlying model can behave like an expert assistant or produce generic noise depending on prompt quality.

Foundational Techniques

Zero-Shot…

Read more →

LangChain is an open-source framework that provides building blocks for LLM applications. Rather than calling OpenAI's API directly and wiring everything by hand, LangChain gives you composable abstractions: chains (sequences of LLM calls), agents (LLMs that choose which tools to call), memory (state across turns), and retrievers (fetch relevant documents).

Core Abstractions

  • LLMs / Chat…
Read more →

Cursor is a fork of VS Code that reimagines the editor as an AI-native environment. While GitHub Copilot adds AI as a plugin to existing editors, Cursor was built from the ground up with AI as a first-class participant, not an afterthought.

Core Features

  • Tab completion, predicts multi-line, multi-cursor edits based on recent changes and file context
  • Cmd+K inline editing, select code,…
Read more →
Page 1