LLM / GenAI Development Tools & Frameworks

LLM Foundations

• Huggingface

• PyTorch

Finetuning

• Unsloth

• LLaMA Factory

• Huggingface

Vector Databases & Search (RAG Backbone)

• FAISS

• Chroma

• Qdrant

• Supabase

• pgvector

• Milvus

• Pinecone

• AWS OpenSearch

• Azure AI Search

Databases & Storage

• Neo4j

• MongoDB

• PostgreSQL

• Redis

• SQL Alchemy

LLM Application Building Framework

• LangChain

• Llama Index

• Haystack

• Lang Smith

Guardrails, Validation & Safety

• Guardrails.ai

• Nvidia Nemo

• OpenAI Guardrail

Local LLMs & Runtime

• Ollama

Experiment Tracking

• MLflow

Data Modelling

• Pydantic

MCP

• FastMCP

Document AI & Parsing

• Llama Parser

• Docling

• Google Document AI

• Amazon Textract

• python-docx

• PyMuPDF

• pdfplumber

• Parsio

• Unstructured.io

• Azure Document Intelligence

Agentic AI Frameworks

• Lang Graph

• Deepagent

• AutoGen

• n8n

Cloud GenAI Platforms

• Google ADK

• Agent Core

• AWS Bedrock

• Azure Cloud Foundry

• GCP Vertex AI

Evaluation & Observability

• RAGAS

• TruLens

• Llama Index Eval

• DeepEval

• OpenAI Evals

Prompt Engineering & Prompt Management

• LangChain Prompt Hub

• PromptLayer

• OpenAI Cookbook / Prompt Examples

• PromptHub (Community-driven repos)

• DSPy (Prompt-as-Code approach)

• Guidance (Microsoft)

Deployment, Infrastructure & CI/CD

• ECS + Fargate + EC2

• AWS SageMaker

• GitHub Actions

• Azure Virtual Machines (VMs)

• Azure Kubernetes Service (AKS)

• Azure Container Apps / ACI

Testing

• pytest

Pipeline Orchestration

• Apache Airflow