Microsoft SQL Server 2005

Peter Koen
[email protected]
http://www.kema.at

Peter Koen

CEO

KEMA – Koen Electronic Media Agency

Consultant

Author

SQL Server Usergroup Austria

www.sqlexperts.at

MCP, MCAD, MCSD.NET, MCDBA, MCT

MVP – Visual Developer C#

CAI R/S, CASE R/S, IAT
2

1
Agenda

SQL Server – Where are we?

The 4th Wave

DBA Features

Development Features

BI Features

Brief History of Database

Use

Database use has exploded over the last
30 years

Most of us directly interact with a DBMS
many times a day

We’re transitioning from humans
interacting with databases to databases
interacting with databases

2
 First 3 Waves of Database

ERP

Automating Reducing Automating

Process Process Process
Steps Steps Steps

Example: Online Query & Example:

Payroll Reporting ERP, HR, CRM

Data Online Enterprise

Processing Processing Computing

1960 2000
5

Big Trend: “Born Digital” Data

100%
Percentage of Information

Word Processing
“Born Digital”

POS Data
Programming on Package
Punched Cards Tracking

0%

1960 2000
6

3
Big Trend: Schema

ERP Vendors Model

Enterprises
Schema Complexity

01 SAMPLE-REC.
03 SA-PAC-DEC-1 PIC 9(7)V99 COMP-3.
03 FILLER PIC X(5).
03 SA-PAC-DEC-2 PIC 999 COMP-3.
03 SA-PAC-DEC-3 PIC S9(3) COMP-3.
XML
COBOL Records
Mapping Files/Memory

Chen’s E-R Paper

1960 2000
7

SQL Server Yesterday & Today

SQL Server 6.0

First SQL Server release shipped solely by Microsoft

Key Features: Enterprise Manager, Replication, Server
Cursors

SQL Server 6.5

Shipped 10 months after 6.0

DTC Integration, New Replication Features

SQL Server 7.0

Major architectural release

Server Mostly rewritten – New QP, Storage Engine

Analysis Features

SQL Server 2000

More high scale engine features: Indexed Views,
Online utilities

Analysis Services, Data Mining, DTS
8

4
Key Observations

People’s time is precious

Cost of managing systems is HUGE!

Can consume CPU, Disk, & Bandwidth to
save people’s time

Allows people to concentrate on more
interesting tasks…

Data, Schema, Processing & Bandwidth

We have the capability to provide end-to-end
digital business (Autonomous Computing)

The ideal autonomous

computing database

Self-managing

Automatic configuration

Automatic, on-line, data maintenance

Easily programmed

Service programming may be deployed within the
database, (or in mid-tier)

Great messaging endpoint

Can directly plumb web services and process
messages via transactions

Must be both a “talker” and a “listener”

Great notification engine

Generates notifications on complex data changes
10

5
 • .NET CLR hosting • Comprehensive ETL platform
• Native XML technology • Real time analytics
• Integrated web services • Accessible, easy data mining
• Distributed application framework • Rich, integrated reporting

• Flexible, interoperable, scalable • 3 years in development

• Improved predictability • Multiple security reviews
• Self optimization and tuning • 1,000+ new and improved features
• Fast recovery and restore • Large private beta for early quality

The comprehensive database platform for rapidly building,

deploying and managing scalable, integrated solutions
11

New Features
.NET Framework Database Maintenance Replication
Common Language Runtime Integration Backup and Restore Enhancements Auto-tuning Replication Agents
User-defined Aggregates Checksum Integrity Checks Oracle Publication
User-defined Data Types Dedicated Administrator Connection Improved Blob Change Tracking
User-defined Functions Dynamic AWE OLAP and Data Mining
SQL Server In-Proc Data Provider Fast Recovery Analysis Management Objects
Extended Triggers Highly-available Upgrade Windows Integrated Backup and Restore
Data Types Online Index Operations Web Services/XML for Analysis
Online Restore DTS and DM Integration
File Stream Storage Attribute
Parallel DBCC Eight new DM algorithms
Managed SQL Types
Parallel Index Operations Auto Packaging and Deployment
New XML Datatype
SQL Server Engine Management Tools Data Transformation Services
MDX Query Editor New Architecture (DTR + DTP)
New Message Service Broker
MDX Intellisense Complex Control Flows
HTTP Support (Native HTTP)
T-SQL Intellisense Control Flow Debugging
Database Tuning Advisor
Version Control Support For Each Enumerations
Enhanced Read ahead & scan
XML/A Property Mappings
Extended Indexes
SQLCMD Command Line Tool Full Data Flow Designer
Multiple Active Result Sets
Persisted Computed Columns Performance Tuning Full DTS Control Flow Designer
Queuing Support Profiler Enhancements Graphical Presentation of Pkg Execution
Snapshot Isolation Level Profiling Analysis Services Immediate Mode and Project Mode
Scale Up Partitioning Exportable Showplan Package (Advanced) Deployment Tools
VIA support Exportable Deadlock Traces Custom Tasks and Transformations
NUMA support Full-text Search Reporting Services
Database Failure and Redundancy Indexing of XML Datatype Multiple Output Formats
Fail-over Clustering (up to 8 node) MDAC Parameters (Static, Dynamic, Hierarchical)
Enhanced Multi-instance Support Side by Side installation Bulk Delivery of Personalized Content
Database Mirroring Microsoft Installer base setup Support Multiple Data Sources
Database Viewpoints Support for Active Directory Deployment Sharepoint Support
XML Visual Design Tool
SQL Client .NET Data Provider Charting, Sorting, Filtering, Drill-Through
XQUERY Support (Server & Mid Tier) Server Cursor Support Scheduling, Caching
XML Data Manipulation Language Asynch Complete Scripting Engine
FOR XML Enhancements
XML Schema (XSD) Support Security Scale Out architecture
All Permissions Grantable XML Report Definition
MSXML 6.0 (Native)
XQuery Designer Fine Grain Administration Rights Notification Services
Separation of Users and Schema
12

6
 SQL Server Yukon Timeline

Beta 2 - Summer 2004

Feature complete

Very good quality

Engine perf ~90% of SQL 2K

Beta 3 – Q4 2004

RC Level quality and perf.

RTM – 2005

13

New for the DBA

Major SQL Server Subsystems

Configuration

Monitoring

Security

Development

Availability

Data Access Concurrency

Database Server Failure or Disaster

Database Maintenance and Operations

Manageability

Scalability and Reporting
14

7
 Fast Recovery
Restart or Restore

SQL Server 2000

Database is Available after Undo Completes

Redo Undo

Time Available

SQL Server 2005

Database is Available when Undo Begins

Redo Undo

Available
15

Database Mirroring

Fault Tolerant Virtual Database

Witness

Clients

Principal Mirror

16

8
Database Mirroring
How It Works

Transaction Shipping

Witness

Principal Mirror

Application

1 5
2
SQL Server SQL Server

2 4 3

17

New for the developer

Database Programming Evolution

New Application Frameworks

.NET Framework Integration

XML Support

Web Services Support

Data Access

18

9
New in SQL Server 2005

Three new application frameworks:

SQL Service Broker

SQL Server Notification Services

SQL Server Reporting Services

New server-side programming support

Stored procedures, triggers, & functions in
C++, C#, or VB

Server-side Abstract Data Types

Industry leading programming tools

19

SQL Service Broker

Inbound messages arrive on protocol pipe

Message is:

Authenticated

Dispatched to appropriate queue Service Program

Service Programs:

Pick up work from queue

Run in different context than
incoming message

May run inside or outside server
process

May send additional messages

Service Queue
Message
Message

Shared Private
Stuff State
20

10
 Notification Services Architecture
Subscription Management Application

Subscribers
Data Subscriber Devices Notifications External
Data Events Subscriptions External
Changes
Changes Delivery
Delivery

Event Provider Generator Distributor

File System Email
Watcher XSLT
SQL CF
XSLT File
Event
SQL Server Provider Match HttpExt
provider Host Rule .NET Alerts *
Custom CF
Custom EP Custom DP

21

Reporting Services Architecture

Browser Office Custom App

Report Control
Report Processing

Rendering Data Proc.

Web UI Security Services

Data Sources
(SQL, OLE DB, XML/A, (NT, Passport,
XML Web Service Interface Custom)
ODBC, Oracle, Custom)
Report Server

Report Processing

Data Processing Security

Scheduling and
Rendering
Delivery
Output Formats Delivery Targets
(HTML, Excel, (E-mail, SharePoint,
SQL Server Catalog Custom) 22
PDF, Custom)

11
 .NET Framework Integration
Key Features

Programming environment for Functions, Stored
Procedures, Triggers

User Defined Types, Aggregates

In-Proc Data Access (ADO.NET V2)

Symmetric data access

Mid-tier/data tier deployment decision

Security

Integration of SQL and CLR security

Three levels of code access security

Safe, External-Access (verifiable), Unsafe

Tight integration with Visual Studio

Authoring, debugging, deployment, & profiling
23

.NET Developer Experience

Build

Developer Visual Studio Assembly

Project

SELECT tax(salary)
FROM Employees
WHERE … CREATE ASSEMBLY
CREATE FUNCTION
CREATE TYPE
SQL Server
24

12
 Assembly & Class Loading
Harddisk
sys.assemblies

Execute

Load FX Validate
version assembly
Assembly
25

.NET Integration
Key Theme: Choice & Control

Choice of where to run logic

Database, for logic that runs close to data

Mid-tier, for logic that scales out

Symmetric programming model

Leverage skills mid-tier & server

Choice of programming language

C#, VB.NET, & Managed C++, for a safe, modern
execution environment

T-SQL continues to be supported & enhanced

Remains good choice for data-intensive procedures

Safe extended stored proc replacement
26

13
TSQL vs. C# - data
conversion
if @bin is null return null
declare @len int, @b tinyint, @lowbyte tinyint, @hibyte tinyint, @index int, @str nchar(2), @result nvarchar(4000)
set @len = datalength(@bin)
set @index = 1
set @result = '0x'
while @index <= @len
begin
set @b = substring(@bin, @index, 1)
set @index = @index + 1
set @lowbyte = @b & 0xF
set @hibyte = @b & 0xF0
if @hibyte > 0
set @hibyte = @hibyte / 0xF
set @result = @result +
((case
when @hibyte < 10 then convert(varchar(1), @hibyte)
when @hibyte = 10 then 'A'
when @hibyte = 11 then 'B'
when @hibyte = 12 then 'C'
when @hibyte = 13 then 'D'
when @hibyte = 14 then 'E'
when @hibyte = 15 then 'F'
else 'Z'
end)
if (value == null) return null; +
(case
StringBuilder sb = new StringBuilder(); when @lowbyte < 10 then convert(varchar(1), @lowbyte)
when @lowbyte = 10 then 'A'
foreach (byte b in value) when @lowbyte = 11 then 'B'
when @lowbyte = 12 then 'C'
sb.Append(b.ToString("X2")); when @lowbyte = 13 then 'D'
when @lowbyte = 14 then 'E'
return sb.ToString(); when @lowbyte = 15 then 'F'
else 'Z'
end))
end

27

TSQL vs. C# for relational task

SELECT * FROM T_CUSTOMERS WHERE C_CITY = @name

private static readonly SqlDefinition x_definition;

string query = “SELECT * FROM T_CUSTOMERS WHERE C_CITY = @name”;
SqlCommand cmd = new SqlCommand();
cmd.CommandText = query;
cmd.Parameters.Add(new SqlParameter("@name", SqlDbType.NVarChar, 128));
x_definition = new SqlDefinition(cmd);
SqlExecutionContext sec =
SqlContext.GetConnection().CreateExecutionContext(x_definition);
sec.SetSqlString(0, "ExecutePredefinedQuery");
SqlContext.GetPipe().ExecuteReader(sec);

28

14
Yukon XML Support

XML data type & XML index support

Unified XML & relational store

Both SQL & XQuery supported by same
industrial strength infrastructure

Leverages existing SQL engine & optimizer

XQuery with data modification extensions

XML views

Declarative Mapping Files

XML schema enforcement

Client access using ADO.NET & SOAP
29

XML Scenarios
Data Exchange…

XML data

Point-of-Sales Supplier

 Platform independent transport format

 Loosely-coupled systems
 B2B, B2C, work flow, …
30

15
XML Scenarios
Semi-structured storage…

First Name Last Name Address Phone XML data

type

XML Datatype

Loosely structured data

Data with a dynamic schema

XML Views

Mixed data – structured/unstructured

XML stores w/o relational support challenged 31

Native XML Store

XML Data Type

XML data type

Native SQL type

Use for column, variable or parameter
CREATE TABLE docs (id INT PRIMARY KEY, xDoc
XML NOT NULL)

Store un-typed or typed XML instances

Well-formed and validation checks

Methods on XML data type

Query(), value(), exist() & modify()

32

16
Native XML Store
XML Data Modification

Insert, update, & delete XQuery
extensions

XML sub-tree modification:

Add or delete XML sub-trees

Update values

Add a new section after section 2:
UPDATE docs SET xDoc::modify(
‘insert <section num=“2”>
<heading>Background</heading>
</section>
after /doc/section[@num=1]')
33

HTTP/SOAP Features

SQL & stored proc calls via HTTP/SOAP

Easy, standards based connectivity from Unix
platforms to SQL Server

Provides native HTTP listening

HTTP endpoint specifying URL, port, reqs

Publish WSDL for endpoints

Standard-based

SOAP 1.1 and 1.2, WSDL 1.1, inlined XSD

Windows and SQL authentication (SSL only)

Stored Proc can return result as DataSet

Compatible with mid-tier prog. model

34

17
Data Access
API Enhancements: ADO .NET V2

Multiple active result sets (MARS)

Object Persistence FX (ObjectSpaces)

Query notifications – for cache invalidation

Functional parity with ADO (ADOX, etc)

Server cursors (SqlResultSet)

Asynchronous client access

Bulk update, paging, and batching

XML Data type support

User Defined Type (UDT) support
35

SQL Server BI Platform

Reporting Services
Development Tools

Management Tools

Analysis Services
OLAP & Data Mining

Data Transformation
Services
ETL

SQL Server
Relational Engine

36

18
Analysis Services

Unified Dimensional Model

Integrating relational and OLAP views

Pro-active caching

Bringing the best of MOLAP to ROLAP

Advanced Business Intelligence

MDX scripts, translations, currency…

Web services

Native XML

37

Data Mining

Significant investment

Important, new algorithms

Association rules, time series, regression
trees, sequence clustering, neural nets, …

Embedded, integrated, complete

38

19
Microsoft Office System Integration

Office Document Formats

Excel, Word, outlook

Import reports from Access

HTML rendering

Interactive Charts, PivotTables, Spreadsheets

SharePoint Portal Server Integration

Report Web Parts

Report delivery to document libraries, lists

Report Library Template

Searchable

39

Questions, Discussions?

40

20