CS 886: Recent Advances on Foundation Models Winter 2024 is a course instructed by Dr. Wenhu Chen at the University of Waterloo. The course covers topics related to foundation models, deep learning, and multimodal models. It includes lectures, student presentations, reading notes, and a course project. Students are required to submit high-quality reports and presentations on foundation models, with assessments based on in-class presentations, reading notes, and the course project. Communication is facilitated through the Piazza discussion board, and the course aims to explore cutting-edge advancements in the field of foundation models.
url: https://cs.uwaterloo.ca/~wenhuche/teaching/cs886/
title: "CS 886: Recent Advances on Foundation Models"
description: "Home page for CS 886"
host: cs.uwaterloo.ca
url: https://www.youtube.com/playlist?list=PLoROMvodv4rNiJRchCzutFw5ItR_Z27CM
title: "Stanford CS25 - Transformers United"
description: "Stanford CS25: Transformers United Since their introduction in 2017, transformers have revolutionized Natural Language Processing (NLP). Now, transformers ar..."
host: www.youtube.com
favicon: https://www.youtube.com/s/desktop/3ee2b817/img/favicon_32x32.png
image: https://i.ytimg.com/vi/P127jhj-8-Y/hqdefault.jpg?sqp=-oaymwEWCKgBEF5IWvKriqkDCQgBFQAAiEIYAQ==&rs=AOn4CLC1iqLBy9WkQai1HPBo0QSELtI_ow&days_since_epoch=19820
The YouTube channel of Andrej Karpathy focuses on topics related to deep learning, neural networks, and backpropagation. Andrej Karpathy has been training deep neural networks for over a decade and shares insights into these complex subjects. The channel provides educational content on building micrograd, understanding derivatives, and exploring the intricacies of neural network training. Viewers can expect detailed explanations and tutorials on these advanced topics in the field of artificial intelligence and machine learning.
YouTube Playlist Neurail Network Zero to Hero
url: https://www.youtube.com/@AndrejKarpathy
title: "Andrej Karpathy"
description: "FAQQ: How can I pay you? Do you have a Patreon or etc?A: As YouTube partner I do share in a small amount of the ad revenue on the videos, but I don't maintain any other extra payment channels. I would prefer that people \"pay me back\" by using the knowledge to build something great."
host: www.youtube.com
favicon: https://www.youtube.com/s/desktop/29d8088d/img/favicon_32x32.png
image: https://yt3.googleusercontent.com/ytc/AIdro_n8r_ah4fmhoKuTXWp1Pgtt_8i7tarvZlJ7NSfubjo=s900-c-k-c0x00ffffff-no-rj
url: https://github.com/mlabonne/llm-course
title: "GitHub - mlabonne/llm-course: Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks."
description: "Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks. - mlabonne/llm-course"
host: github.com
favicon: https://github.githubassets.com/favicons/favicon.svg
image: https://opengraph.githubassets.com/c98c6c525abff2ab8401f4b2a97650b46e813491ef1b20f089cbfdfbf9f16b18/mlabonne/llm-course
Generative AI Foundations on AWS is a technical deep dive course that gives you the conceptual fundamentals, practical advice, and hands-on guidance to pre-train, fine-tune, and deploy state-of-the-art foundation models on AWS and beyond. Developed by AWS Generative AI Worldwide Foundations Lead Emily Webber, this free hands-on course and the supporting GitHub source code. If you are looking for a curated playlist of the top resources, concepts, and guidance to get up to speed on foundation models, and especially those that unlock generative capabilities in your data science and machine learning projects, then look no further.
During this 8-hour deep dive, you will be introduced to the key techniques, services, and trends that will help you understand foundation models from the ground up. This means breaking down theory, mathematics, and abstract concepts combined with hands-on exercises to gain functional intuition for practical application. Throughout the course, we focus on a wide spectrum of progressively complex generative AI techniques, giving you a strong base to understand, design, and apply your own models for the best performance. We’ll start with recapping foundation models, understanding where they come from, how they work, how they relate to generative AI, and what you can to do customize them. You’ll then learn about picking the right foundation model to suit your use case.
Once you’ve developed a strong contextual understanding of foundation models and how to use them, you’ll be introduced to the core subject of this course: pre-training new foundation models. You’ll learn why you’d want to do this as well as how and where it’s competitive. You’ll even learn how to use the scaling laws to pick the right model, dataset, and compute sizes. We’ll cover preparing training datasets at scale on AWS, including picking the right instances and storage techniques. We’ll cover fine-tuning your foundation models, evaluating recent techniques, and understanding how to run these with your scripts and models. We’ll dive into reinforcement learning with human feedback, exploring how to use it skillfully and at scale to truly maximize your foundation model performance.
Finally, you’ll learn how to apply theory to production by deploying your new foundation model on Amazon SageMaker, including across multiple GPUs and using top design patterns like retrieval augmented generation and chained dialogue. As an added bonus, we’ll walk you through a Stable Diffusion deep dive, prompt engineering best practices, standing up LangChain, and more.
Generative AI Foundations on AWS Technical Deep Dive Series
url: https://www.youtube.com/playlist?list=PLhr1KZpdzukf-xb0lmiU3G89GJXaDbAIF
title: "Generative AI Foundations on AWS Technical Deep Dive Series"
description: "Generative AI Foundations on AWS is a technical deep dive course that gives you the conceptual fundamentals, practical advice, and hands-on guidance to pre-t..."
host: www.youtube.com
favicon: https://www.youtube.com/s/desktop/29d8088d/img/favicon_32x32.png
image: https://i.ytimg.com/vi/oYm66fHqHUM/hqdefault.jpg?sqp=-oaymwEWCKgBEF5IWvKriqkDCQgBFQAAiEIYAQ==&rs=AOn4CLBEZ-70CTCci4Ij_jcOZn_Rahf4wA&days_since_epoch=19791
Are you ready to dive into the world of AI applications? This course was designed for you. AI orchestration frameworks let you step back from the details of artificial intelligence tools and APIs and instead focus on building more general, effective systems that solve real-world problems. Join instructor M.Joel Dubinko as he explores the business benefits of AI orchestration—faster development, smarter interfaces, lower costs, and more. This course provides an overview of AI fundamentals and key capabilities, like accessing external tools and databases, with a special focus on exploring local models running on your own hardware, alongside or instead of cloud services like those from OpenAI. Every step of the way, Joel offers hands-on demonstrations of two industry-leading frameworks: LangChain and LlamaIndex. By the end of this course, you’ll be prepared to start building chatbots, intelligent agents, and other useful tools, while monitoring for errors and troubleshooting as you go.
Mervian Praison - You Tube Channel
https://www.youtube.com/@MervinPraison
url: https://www.youtube.com/@MervinPraison
title: "Mervin Praison"
description: "Mervin Praison"
host: www.youtube.com
favicon: https://www.youtube.com/s/desktop/fe730087/img/favicon_32x32.png
image: https://yt3.googleusercontent.com/ZHI8UUVgJg1fKIvD3nLHTC2BIIrnivaR5HWq_-pUWFov2Xkpz7rHw1D8qAvmxZ4zW8-ciGyvAg=s900-c-k-c0x00ffffff-no-rj
Generative AI Full Course – Gemini Pro, OpenAI, Llama, Langchain, Pinecone, Vector Databases & More
This course is about learning generative models and different frameworks, with a focus on investigating the production of text and visual material by artificial intelligence.
- ⌨️ (00:00:00) DAY 1: Introduction to Generative AI Community Course
- ⌨️ (01:44:14) DAY 2: Introduction to OpenAI and understanding the OpenAI API
- ⌨️ (03:37:49) DAY 3: Introduction to LangChain
- ⌨️ (05:16:48) Day 4: Hugging Face API + Langchain
- ⌨️ (07:13:08) DAY 5: Memory in Langchain
- ⌨️ (09:07:53) DAY 6: LLM Generative AI Project using OpenAI & LangChain
- ⌨️ (11:03:29) DAY 7: LLM Generative AI Project & Deployment
- ⌨️ (13:09:02) DAY 8: Introduction to Vector Database for AI & LLM
- ⌨️ (14:52:41) DAY 9: Mastering Vector Databases with Pinecone
- ⌨️ (17:02:19) DAY 10: Mastering ChromaDB Vector Databases
- ⌨️ (19:04:25) DAY 11: Introducing Meta Llama 2
- ⌨️ (20:54:33) DAY 12: End to End Medical Chatbot Project, Part 1
- ⌨️ (22:36:05) DAY 13: End to End Medical Chatbot Project, Part 2
- ⌨️ Generative AI: Everything You need to know about Gemini Pro LLM Models
- ⌨️ (26:16:33) End to End Gen AI Project using Google Gemini Pro
- ⌨️ (28:24:14) Webinar - Generative AI Revolution: The Future
url: https://www.youtube.com/watch?v=mEsleV16qdo
title: "Generative AI Full Course – Gemini Pro, OpenAI, Llama, Langchain, Pinecone, Vector Databases & More"
description: "Learn about generative models and different frameworks, investigating the production of text and visual material produced by artificial intelligence. This co..."
host: www.youtube.com
favicon: https://www.youtube.com/s/desktop/29d8088d/img/favicon_32x32.png
image: https://i.ytimg.com/vi/mEsleV16qdo/maxresdefault.jpg
Lightning AI - Learning Lab Immerse yourself in a curated collection of blogs, tutorials, and how-to videos to help you unlock the transformative potential of large language models.
url: https://lightning.ai/pages/llm-learning-lab/?utm_source=akshay
title: "LLM Learning Lab - Lightning AI"
description: "Immerse yourself in a curated collection of blogs, tutorials, and how-to videos to help you unlock the transformative potential of large language models."
host: lightning.ai
favicon: https://lightning.ai/favicon/favicon.ico
image: https://lightningaidev.wpengine.com/wp-content/uploads/2023/06/llm-1.jpg
DeepLearning.AI Short Courses
url: https://spreadsheets-are-all-you-need.ai/index.html#watch-the-lessons
title: "Spreadsheets are all you need.ai – A low-code way to learn AI"
host: spreadsheets-are-all-you-need.ai