Sebastian Raschka, PhD’s Post

This book is timely for the people who want to understand how LLMs are built from the inside. Learning how this works could mean domain-specific LLMs or SLMs (small language models). I am planning to buy a copy soon 😁👍

I’ve been reading this book as it’s been developed via Manning’s MEAP program. It is a fantastic book! Sebastian does a great job at explaining things simply, using nice, simple visuals to provide that intuitive understanding. He also provides the code at each step in the process. If you’re a data scientist or machine learning engineer interested in this topic, I can very easily recommend this book!

Only book you need along with Andrej Karpathy’s video on YouTube to understand LLM ground up! Infact, Sebastian suggested an effective 11-step LLM study plan in one of his post and I am finding this incredibly valuable- 1) Read Chapters 1 and 2 on implementing the data loading pipeline (https://lnkd.in/gfruEiwm & https://lnkd.in/gyDm4h3y). 2) Watch Karpathy's video on training a BPE tokenizer from scratch (https://lnkd.in/gZEsdpYc). 3) Read Chapters 3 and 4 on implementing the model architecture. 4) Watch Karpathy's video on pretraining the LLM. 5) Read Chapter 5 on pretraining the LLM and then loading pretrained weights. 6) Read Appendix E on adding additional bells and whistles to the training loop. 7) Read Chapters 6 and 7 on finetuning the LLM. 8) Read Appendix E on parameter-efficient finetuning with LoRA. 9) Check out Karpathy's repo on coding the LLM in C code (https://lnkd.in/gHpt5uh9). 10) Check out LitGPT to see how multi-GPU training is implemented and how different LLM architectures compare (https://lnkd.in/gzYc69c7). 11) Build something cool and share it with the world.

Not perfect, but you can get a glimpse into the future - when you can get personalized video generated let's say from your favorite book. Made for you! This video is created with OpenAI's Sora: https://openai.com/sora

This has been a big week! The official publication date for my new book, Executive Functions for Every Classroom, is here. A HUGE thank you to everyone who has already purchased a copy. Your support truly means the world to me. You can pick up a copy of my book here: https://bit.ly/42pCMbq #executivefunctioningskills #executivefunctions

"Befriending Time" is now available on Amazon in Paperback and e_Book formats. An excerpt of the introduction: "There are many books and teachings on conquering time and mastering it through many disciplined ways of organizing your life, creating task lists, and working around them. This book is not one more publication about it. On the other hand, it will not teach how to give up and live happily, paying no attention to time, but it will provide you with a new way to partner with time as your ally, reverting what you thought about it."

Exactly! Use my “Hard Choices” book as a discussion starter. Here is the link to Amazon for my “Hard Choices” book: https://lnkd.in/eYftDAmp

If you know me (or have visited my office at Purdue University Daniels School of Business), you know I love to read. It's in Input and Learner in me. This looks like a great list of new books to add to my TBR pile. I already had Charles Duhigg's book on the list. #leadershipdevelopment #leadersarereaders #tbrpile #bookrecommendations

Check out 12 new idea books for 2024 from Adam Grant, an organizational psychologist at Wharton and #1 bestselling author. These picks dive into essential business issues, including mental health, community, leadership, productivity, and more. What would you add to the list?

🎉 Exciting Update Alert! 🎉 Stage 8: The publishing phase is officially underway! 📚✨ Now comes the hard part: deciding on the final size, debating between paperback or hardcover, snagging that ISBN, and mastering the art of formatting and uploading my book to Amazon KDP. 💻📝 Can't wait to see this project come to life! Stay tuned for more updates! #PublishingJourney #AuthorLife #BookLaunchPrep #thefirstafter #selfpublishingauthor #dontknowwhatimdoing