Gupta N., Yip J. - Databricks Data Intelligence Platform [2024, PDF, ENG]

Книги и журналы » Компьютерная литература » Программирование (книги)

Databricks Data Intelligence Platform

Год издания: 2024
Автор: Gupta N., Yip J.

Издательство: Apress
ISBN: 979-8-8688-0444-1
Язык: Английский

Формат: PDF
Качество: Издательский макет или текст (eBook)
Интерактивное оглавление: Да
Количество страниц: 481

Описание: This book is your comprehensive guide to building robust Generative AI solutions using the Databricks Data Intelligence Platform. Databricks is the fastest-growing data platform offering unified analytics and AI capabilities within a single governance framework, enabling organizations to streamline their data processing workflows, from ingestion to visualization. Additionally, Databricks provides features to train a high-quality large language model (LLM), whether you are looking for Retrieval-Augmented Generation (RAG) or fine-tuning.
Databricks offers a scalable and efficient solution for processing large volumes of both structured and unstructured data, facilitating advanced analytics, machine learning, and real-time processing. In today's GenAI world, Databricks plays a crucial role in empowering organizations to extract value from their data effectively, driving innovation and gaining a competitive edge in the digital age. This book will not only help you master the Data Intelligence Platform but also help power your enterprise to the next level with a bespoke LLM unique to your organization.
Beginning with foundational principles, the book starts with a platform overview and explores features and best practices for ingestion, transformation, and storage with Delta Lake. Advanced topics include leveraging Databricks SQL for querying and visualizing large datasets, ensuring data governance and security with Unity Catalog, and deploying machine learning and LLMs using Databricks MLflow for GenAI. Through practical examples, insights, and best practices, this book equips solution architects and data engineers with the knowledge to design and implement scalable data solutions, making it an indispensable resource for modern enterprises.
Whether you are new to Databricks and trying to learn a new platform, a seasoned practitioner building data pipelines, data science models, or GenAI applications, or even an executive who wants to communicate the value of Databricks to customers, this book is for you. With its extensive feature and best practice deep dives, it also serves as an excellent reference guide if you are preparing for Databricks certification exams.
What You Will Learn:
- Foundational principles of Lakehouse architecture
- Key features including Unity Catalog, Databricks SQL (DBSQL), and Delta Live Tables
- Databricks Intelligence Platform and key functionalities
- Building and deploying GenAI Applications from data ingestion to model serving
- Databricks pricing, platform security, DBRX, and many more topics
[spoiler="Примеры страниц (скриншоты)"]

[/spoiler]
[spoiler="Оглавление"]
About the Authors xv
About the Technical Reviewers xvii
Chapter 1: Databricks Platform: From Lakehouse to Data Intelligence Platform 1
Chapter 2: Databricks Platform Overview 15
Chapter 3: Data Ingestion in Lakehouse 45
Chapter 4: Delta Lake - Deep Dive 61
Chapter 5: Data Governance with Unity Catalog 89
Chapter 6: Data Engineering Part 1: Orchestrating Data Pipelines Using Databricks Workflows 113
Chapter 7: Data Engineering Part 2: Delta Live Tables 133
Chapter 8: Data Warehousing with DBSQL 153
Chapter 9: Machine Learning Operations Using Databricks 181
Chapter 10: Generative AI with Databricks 219
Chapter 11: Large Language Model Operations 255
Chapter 12: Mosaic AI Agent Framework: Creating Quality AI Agents 285
Chapter 13: DBRX: Creating an LLM from Scratch Using Databricks 311
Chapter 14: The Databricks Data Intelligence Platform 331
Chapter 15: Databricks CI/CD 353
Chapter 16: Databricks Pricing and Observability Using System Tables 371
Chapter 17: Databricks Platform Security and Compliance 389
Chapter 18: Spark Structured Streaming: A Comprehensive Guide 409
Chapter 19: From Ideation to Creation: A Walk-Through of Building a GenAI Application 431
Index 457
[/spoiler]