PASS Summit Keynote Live Blog – Day 2

20 October, 2013 (15:19) | SQL | By: Mark V

Behold my live blog for Dr. David DeWitt’s fabulous keynote.

<<Please click post title for Live Blog entries>>

Mark V October 17, 20138:48 am

Thanks for following! And huge thanks to Dr. DeWitt for an awesome presentation as always.

Mark V October 17, 20138:47 am

I hate to bail on this early. But I need to get prepped for my presentation at the other end of building. :(

Mark V October 17, 20138:45 am

dll created in #Hekaton is targeted for that query. VERY lean.

Mark V October 17, 20138:44 am

Physical query execution plans likely to be very different in #Hekaton than “classic” sql server.

Mark V October 17, 20138:42 am

A big key for #Hekaton: Stored Procedures rule.

Mark V October 17, 20138:40 am

Post-Processing: wrapping it all up

Mark V October 17, 20138:39 am

Validation: Determines if the transaction can be safely committed.

Mark V October 17, 20138:39 am

Normal Processing: transactions go through processing without locks (for the most part).

Mark V October 17, 20138:38 am

DeWitt digging into Post Processing phase. I will try to sum it up.

Mark V October 17, 20138:36 am

Note: #Hekaton Phantom Avoidance does not involve Buffy the Vampire Slayer.

Mark V October 17, 20138:35 am

Dr. DeWitt digging into Isolation Levels as they relate to the Validation phase of #Hekaton transactions.

Mark V October 17, 20138:32 am

Wrapping up: Updates create new versions. Trans use Timestamps and versions for concurency.

Mark V October 17, 20138:32 am

#Hekaton has a garbage collector to remove the expired rows once they are not usable: based on Timestamps.

Mark V October 17, 20138:28 am

Dear Dr. DeWitt, passion and enthusiasm are a huge asset for a presenter. Keep letting it shine!

Mark V October 17, 20138:26 am

#Hekaton uses Timestamps both on the Rows AND on the Transactions.

Mark V October 17, 20138:23 am

#Hekaton End Timestamps are always unique. Very important concept there.

Mark V October 17, 20138:22 am

Presenters please not that Dr. DeWitt has not read to us once. He is talking, not reading.

Mark V October 17, 20138:21 am

Since each Transaction gets a unique number, it can maintain proper order of tran commits without locking.

Mark V October 17, 20138:20 am

Reliance on Timestamps allows each Transaction to get the proper version of any row to read.

Mark V October 17, 20138:19 am

DeWitt going into Transaction Phases in #Hekaton: Normal Processing, Validation, Post-Processing

Mark V October 17, 20138:17 am

#Hekaton uses Multiversioning for Concurrency. Changes create new rows. #TypeIISCDForTheWin?

Mark V October 17, 20138:16 am

#Hekaton took 5 years for a VERY good reason. Hard stuff right there.

Mark V October 17, 20138:15 am

Lock-Free structures allow any number of reader and updater threads to do their work with NO performance hit.

Mark V October 17, 20138:14 am

Dr. DeWitt’s animations for showing Lock-Free data structures is AWESOME.

Mark V October 17, 20138:11 am

Lock-Free data structures are the only way to get rid of the latches, spin-locks, etc that get in the way of perf

Mark V October 17, 20138:10 am

DeWitt: “I can barely understand Lock-Free data structures.” #Yikes

Mark V October 17, 20138:09 am

Diving into details of Lock-Free data structures… Oh boy.

Mark V October 17, 20138:08 am

#Hekaton seeing 5X to 30X performance boost.

Mark V October 17, 20138:07 am

EVERY #Hekaton table must have a Primary Key: either HASH or RANGE.

Mark V October 17, 20138:06 am

How do you use #Hekaton? Create a MEMORY_OPTIMIZED table. VERY simple to do.

Mark V October 17, 20138:05 am

Huge thanks to the DBAs who go deep into Internals so that BI folk like me don’t have to. #Respect

Mark V October 17, 20138:04 am

#Hekaton uses Lock-Free data structures. No latches. Timestamps + optimistic concurrency control. Compilation into DLL.

Mark V October 17, 20138:00 am

The number of brilliant people who have made my career in #sqlserver possible is staggering. #Wow

Mark V October 17, 20137:58 am

Two Rules of 2 Phase locking: 1. Query must acquire appropriate Lock. 2. Query cannot get a new once it releases a Lock.

Mark V October 17, 20137:57 am

Jim Gray, DeWitt’s late mentor, created the idea of 2 Phase Locking for Concurrency.

Mark V October 17, 20137:55 am

Dr. DeWitt now going into Serial Schedules while discussing Concurrency. #LearningStuff

Mark V October 17, 20137:54 am

Dr. DeWitt explaining how latches can be a very contentious aspect of the Buffer Pool. Can be a big perf hit.

Mark V October 17, 20137:50 am

I will try to keep up. #TallOrder

Mark V October 17, 20137:50 am

DeWitt will explain why pinning tables in memory will not do the trick to improve performance dramatically.

Mark V October 17, 20137:49 am

Getting 100X improvement impossible with today’s software. Would have to reduce number of instructions by 99%.

Mark V October 17, 20137:47 am

CPUs not getting faster. That well is dry.

Mark V October 17, 20137:46 am

DeWitt: OLTP growing at a modest rate. We see more of these workloads fitting in memory.

Mark V October 17, 20137:44 am

Dr. DeWitt looking dapper in his “smart business casual attire.”

Mark V October 17, 20137:43 am

Hekaton = OLTP Rocket Ship

Mark V October 17, 20137:42 am

DeWitt: If you think my past keynotes have been hard to understand, take two Advil now.

Mark V October 17, 20137:40 am

Dr. David DeWitt taking the stage to discuss #Hekaton.

Mark V October 17, 20137:40 am

SQLClinic a GREAT opportunity to get expert advice from Microsoft personnel.

Mark V October 17, 20137:39 am

Birds of a Feather Luncheon tomorrow. I am leading a table around BI. Can chew and chat.

Mark V October 17, 20137:36 am

79 different countries tuned in to #PASSTV so far. That is fantastic!

Mark V October 17, 20137:35 am

PASS Current VP Marketing, incoming PASS President Thomas LaRock taking the stage.

Mark V October 17, 20137:33 am

Recognizing Rushabh Mehta for contributions to PASS.

Mark V October 17, 20137:32 am

Recognizing Rob Farley who migrates off the board as well. Thanks, mate.

Mark V October 17, 20137:32 am

Recognizing Douglas McDowell who is migrating off the PASS Board. Thank you!

Mark V October 17, 20137:31 am

PASS Bill Graziano taking the stage.

Mark V October 17, 20137:30 am

PASS IT has THREE people maintaining over 500 websites. Thanks for them for their work to keep us going.

Mark V October 17, 20137:29 am

PASS spent a little over $7.6 million in the past fiscal year. 30% of that spending outside the US. #GlobalInitiativesForTheWin

Mark V October 17, 20137:27 am

PASS has $1million in reserves. That is a great safety net for such an important organization.

Mark V October 17, 20137:25 am

PASS org broken into Portfolios, each with their own budget. Partitioning? (Couldn’t resist).

Mark V October 17, 20137:24 am

Second largest funding source is PASS Business Analytics Conference. 900 attendees. Raise $100k for PASS. Awesome.

Mark V October 17, 20137:22 am

Over 75% of PASS funding comes from the annual Summit.

Mark V October 17, 20137:21 am

Be sure to check out the Exhibitors. They make #Summit13 possible.

Mark V October 17, 20137:20 am

Douglas McDowell(PASS Executive VP) taking the stage.

Mark V October 17, 20137:18 am

Lights going dim. Here we go.

Mark V October 17, 20137:10 am

Good morning from PASS Summit 2013. It’s Day 2, which means it’s time for the Dr. David Dewitt keynote! Thanks for following along.

Write a comment