Drill to Detail Ep.31 'Dremel, Druid and Data Modeling on Google BigQuery' With Special Guest Dan McClary
Mark is joined by returning special guest Dan McClary to talk about data modeling and database design on distributed query engines such as Google BigQuery, the underlying Dremel technology and columnar storage format that enables this cloud distributed data warehouse-as-a-service platform to scale to petabyte-size tables spanning tens of thousands of servers, and techniques to optimize BigQuery table joins using nested fields, table partitioning and denormalization.
- Dremel: Interactive Analysis of Web-Scale Datasets
- BigQuery under the hood
- Inside Capacitor, BigQuery’s next-generation columnar storage format
- Drill To Detail Ep.2. 'Future Of SQL On Hadoop', With Special Guest Dan McClary
- Google BigQuery, Large Table Joins and How Nested, Repeated Values and the Capacitor Storage Format (and Looker) Saves the Day