AI Developer Hub

Welcome to the AI Developer Hub repository! This project contains Jupyter Notebook tutorials and guides for training, fine-tuning, and inference using popular machine learning frameworks on AMD GPUs.

Current Notebooks

Category	Title	GitHub Link	AMD Tutorial Page
Inference Tutorials	Hugging Face Transformers	GitHub	AMD Tutorial
	Hugging Face TGI	GitHub	AMD Tutorial
	Deploying with vLLM	GitHub	AMD Tutorial
	From Chatbot to Rap Bot with vLLM	GitHub	AMD Tutorial
	RAG with LlamaIndex and Ollama	GitHub	AMD Tutorial
	OCR with Vision-Language Models with vLLM	GitHub	AMD Tutorial
	Building AI Pipelines for Voice Assistants	GitHub	AMD Tutorial
Fine-Tuning Tutorials	VLM with PEFT	GitHub	AMD Tutorial
	LLM with LoRA	GitHub	AMD Tutorial
	LLM with QLoRA	GitHub	AMD Tutorial
	Llama-3.1 8B with torchtune	GitHub	AMD Tutorial
Pretraining Tutorials	OLMo Model with PyTorch FSDP	GitHub	AMD Tutorial
	Training Configuration with Megatron-LM	GitHub	AMD Tutorial
	LLM with Megatron-LM	GitHub	AMD Tutorial
	Llama-3.1 8B with torchtitan	GitHub	AMD Tutorial
About	Licensing and Support Information	GitHub	AMD Tutorial

Repository Structure

The tutorials are organized into three main categories:

• Fine-Tuning: Examples and guides for fine-tuning machine learning models.
• Pretraining: Tutorials on pretraining models from scratch.
• Inference: Resources for running inference with trained models.

Directory Layout

github_repo/
├── docs/                          # Documentation for the tutorials
│   ├── index.md                   # Main documentation index
│   ├── fine_tune.md               # Fine-tuning tutorials index
│   ├── pretrain.md                # Pretraining tutorials index
│   ├── inference.md               # Inference tutorials index
│   └── notebooks/                 # Jupyter notebooks organized by category
│       ├── fine_tune/             # Fine-tuning notebooks
│       ├── pretrain/              # Pretraining notebooks
│       └── inference/             # Inference notebooks